-- Logs begin at Wed 2022-09-07 18:23:29 UTC, end at Wed 2022-09-07 19:35:50 UTC. -- Sep 07 19:05:43.004763 dv-cinder-847732-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 19:05:43.013526 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 19:05:43 2022] *** Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: nodename: dv-cinder-847732-5-iscsi Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: machine: x86_64 Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: clock source: unix Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: pcre jit disabled Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: detected number of CPU cores: 4 Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: current working directory: / Sep 07 19:05:43.015447 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: detected binary path: /usr/bin/uwsgi-core Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: your processes number limit is 47680 Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: your memory page size is 4096 bytes Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: detected max file descriptor number: 2048 Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: lock engine: pthread robust mutexes Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: thunder lock: enabled Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 19:05:43.016187 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 19:05:43.055308 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: Python main interpreter initialized at 0x557d08b669c0 Sep 07 19:05:43.055308 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: python threads support enabled Sep 07 19:05:43.055308 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: your server socket listen backlog is limited to 100 connections Sep 07 19:05:43.055308 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: your mercy for graceful operations on workers is 90 seconds Sep 07 19:05:43.055666 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 19:05:43.055744 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: *** Operational MODE: preforking *** Sep 07 19:05:43.055977 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: *** uWSGI is running in multiple interpreter mode *** Sep 07 19:05:43.055977 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: spawned uWSGI master process (pid: 106047) Sep 07 19:05:43.056166 dv-cinder-847732-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 19:05:43.056696 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: spawned uWSGI worker 1 (pid: 106048, cores: 1) Sep 07 19:05:43.057521 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: spawned uWSGI worker 2 (pid: 106049, cores: 1) Sep 07 19:05:43.057521 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 19:05:43.713890 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 19:05:43.715540 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 19:05:44.797157 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:05:44.797157 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: from cryptography.utils import int_from_bytes Sep 07 19:05:44.797760 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:05:44.797760 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: from cryptography.utils import int_from_bytes Sep 07 19:05:44.798172 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:05:44.798172 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: from cryptography.utils import int_from_bytes Sep 07 19:05:44.798337 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:05:44.798337 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: from cryptography.utils import int_from_bytes Sep 07 19:05:47.267623 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 19:05:47.268120 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 19:05:47.268470 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 19:05:47.268577 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 19:05:47.268662 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 19:05:47.268742 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 19:05:47.268827 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 19:05:47.268906 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 19:05:47.268990 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 19:05:47.269081 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 19:05:47.269356 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.269584 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.269712 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.269845 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.269987 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270108 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270304 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270406 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270653 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270766 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.270993 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271079 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271311 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271409 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271630 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271720 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.271957 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272061 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272215 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272310 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272527 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272620 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272849 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-5-iscsi {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.272941 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-5-iscsi {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273169 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273262 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273474 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273559 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273780 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.273873 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274092 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274178 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274393 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274488 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274751 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.274852 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.275056 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.275150 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.275548 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.275655 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.276708 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.276842 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.276980 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277068 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277148 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277220 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277297 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277409 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277519 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277603 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277681 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277758 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277834 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.277913 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278090 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278221 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278419 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278524 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278737 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.278858 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279134 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-5-iscsi {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279244 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-5-iscsi {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279449 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279609 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279742 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.279886 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280043 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280187 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280453 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280610 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280756 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.280861 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281062 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281156 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281378 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281470 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281697 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.281857 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282021 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282109 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282328 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282413 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282666 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282773 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.282987 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283073 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283304 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283398 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283607 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283701 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283909 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.283994 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284216 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284300 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284530 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284624 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284833 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.284917 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285133 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285218 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285380 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285467 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285683 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.285767 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.286001 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.286092 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.286318 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.286412 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.287424 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.287583 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.287686 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.287900 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.287991 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288071 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288222 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288333 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288541 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288636 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288843 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.288926 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289147 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289229 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289450 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289534 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.289836 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290054 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290136 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290358 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290438 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290686 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290789 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.290989 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291090 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291304 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291396 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291615 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291706 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.291937 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292103 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292251 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292392 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292526 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292674 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.292928 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293093 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293229 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293361 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293496 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293635 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293775 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.293928 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294091 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294229 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294396 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294532 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294740 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.294894 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295060 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295203 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295367 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295503 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295673 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295815 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.295957 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296092 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296279 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296417 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296609 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296744 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.296909 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297045 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297191 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297324 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297473 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297642 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297772 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.297914 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298049 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298195 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298368 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298592 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298737 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.298895 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299038 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299181 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299315 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299601 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299734 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.299880 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300023 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300156 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300291 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300450 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300550 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300631 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300718 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.300936 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301035 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301235 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301322 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301537 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301638 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301841 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.301936 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.302141 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.302262 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303022 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303112 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303343 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303433 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303647 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303733 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.303948 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304042 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304250 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304344 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304552 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304637 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304867 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.304963 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305169 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305254 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305643 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305729 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305805 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.305889 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306073 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306165 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306460 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306709 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.306798 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307013 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307110 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307314 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307399 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307627 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307765 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.307924 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308010 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308227 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308315 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308539 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308686 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308843 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.308938 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309146 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309233 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309445 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309540 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309746 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.309833 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310047 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310141 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310348 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310435 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310668 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310759 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.310974 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311106 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311270 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311378 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311585 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311687 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.311900 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312002 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312203 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312298 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312507 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312599 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312805 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.312911 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.313122 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.313216 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:05:47.313454 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.313546 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.313782 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.313876 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314122 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314214 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314435 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314527 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314793 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.314896 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315124 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315218 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315443 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315543 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315755 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.315847 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316069 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316162 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316394 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316493 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316705 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.316796 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317015 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317130 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317325 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317429 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317640 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317774 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.317982 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318082 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318311 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318403 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318649 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318756 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.318968 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319064 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319282 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319379 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319590 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319686 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.319908 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320000 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320235 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320326 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320553 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320637 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320862 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.320945 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321205 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321298 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321547 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321631 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321862 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.321946 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322187 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322272 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322506 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322615 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322843 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.322934 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323155 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323247 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323460 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323544 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323801 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.323884 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324112 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324195 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324421 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324511 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324738 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.324821 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325046 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325142 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325369 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325453 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325678 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325772 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.325987 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326071 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326297 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326389 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326629 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326733 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.326942 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327029 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327271 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327354 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327585 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327683 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327907 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.327990 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328220 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328303 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328529 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328622 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328846 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.328954 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329153 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329240 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329462 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329555 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329772 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.329856 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330075 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330159 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330377 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330468 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330704 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.330790 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331013 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331096 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331318 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331453 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331635 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331719 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.331960 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332055 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332266 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332350 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332597 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332688 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332900 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.332989 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333209 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333293 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333540 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333637 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333851 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.333945 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334156 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334238 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334465 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334585 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334799 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.334896 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335101 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335185 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335522 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335732 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.335824 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336032 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336116 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336353 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336440 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336658 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336750 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.336962 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337045 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337275 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337358 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337584 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337745 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337895 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.337979 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338205 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338288 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338513 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338635 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338860 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.338948 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339171 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339269 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339479 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339602 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339809 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.339937 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340141 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340259 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340474 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340645 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340834 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.340921 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341084 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341185 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341407 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341507 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341711 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.341800 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342021 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342118 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342326 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342421 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342657 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342756 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.342962 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343060 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343271 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343357 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343575 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343660 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343880 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.343974 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344181 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344269 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344484 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344570 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344784 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.344872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345103 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345203 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345407 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345493 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345709 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.345796 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346012 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346098 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346319 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346405 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346685 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346778 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.346992 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.347080 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.347333 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.347419 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.347666 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.347754 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348002 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348101 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348302 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348409 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348613 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.348926 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.349671 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.349833 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.349970 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350100 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350227 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350359 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350492 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350683 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.350829 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351005 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351147 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351314 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351633 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351770 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.351941 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352035 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352265 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352399 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352578 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352718 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.352898 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353035 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353204 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353364 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353525 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353671 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.353865 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354015 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354199 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354470 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354631 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354826 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.354920 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355154 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355239 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355470 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355564 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355782 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.355867 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356094 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356179 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356405 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356531 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356716 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.356868 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357035 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357333 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357432 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357566 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357653 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357902 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.357988 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358225 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358325 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358539 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358677 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358880 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.358964 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359187 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359288 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359504 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359589 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359809 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.359893 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360131 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360223 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360448 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360538 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360761 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.360846 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361079 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361175 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361391 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361474 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361703 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.361799 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362012 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362105 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362316 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362417 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362643 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362744 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.362957 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363054 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363272 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363357 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363580 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363667 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363887 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.363972 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.364194 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.364278 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.364501 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.364585 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.365361 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.365460 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.365678 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.365771 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.365989 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366297 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366418 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366630 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366730 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.366944 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367037 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367266 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367350 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367580 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367664 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.367883 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368050 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368194 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368315 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368509 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368608 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368814 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.368924 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369116 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369212 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369424 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369509 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369726 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.369811 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370037 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370121 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370342 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370434 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370682 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.370771 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371001 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371087 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371304 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371387 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371619 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371755 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.371933 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372019 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372239 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372322 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372547 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372632 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372855 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.372973 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373162 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373254 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373475 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373559 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373784 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.373866 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374092 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374184 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374399 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374482 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374731 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.374815 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375047 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375145 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375354 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375438 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375665 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375750 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.375971 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376068 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376272 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376355 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376578 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376668 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376880 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.376965 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.377187 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.377454 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.377538 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.377789 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378053 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378138 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378387 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378473 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378730 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.378818 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379051 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379149 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379396 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379488 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379713 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.379809 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380023 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380153 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380373 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380474 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380686 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380772 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.380990 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381073 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381293 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381379 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381597 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381681 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381902 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.381995 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382360 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382506 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382611 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382837 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.382933 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383143 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383236 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383449 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383533 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383752 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.383843 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384056 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384150 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384356 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384659 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384752 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.384968 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385058 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385269 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385359 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385581 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385674 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385886 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.385977 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386190 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386283 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386494 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386618 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386824 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.386909 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387131 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387217 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387435 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387521 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387776 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.387860 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388082 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388175 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388419 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388505 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388724 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.388816 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389029 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389113 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389352 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389438 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389658 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389740 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.389961 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390044 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390266 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390359 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390588 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390675 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390895 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.390996 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.391195 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.391279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.391502 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.391586 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.391803 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392006 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392113 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392198 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392419 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392510 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392720 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.392815 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393024 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393324 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393417 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393631 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393728 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.393935 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394027 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394236 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394320 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394540 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394637 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394866 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.394959 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395167 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395252 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395468 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395553 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395773 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.395855 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396098 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396220 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396406 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396492 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396709 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.396793 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397014 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397101 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397315 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397411 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397618 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397704 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.397922 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398015 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398223 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398308 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398531 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398639 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398863 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.398961 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399168 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399252 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399473 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399565 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399778 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.399875 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400080 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400164 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400383 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400483 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400683 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400775 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.400986 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401078 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401295 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401387 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401599 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401684 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401910 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.401996 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402213 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402297 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402518 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402664 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402847 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.402932 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403150 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403233 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403455 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403542 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403757 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.403848 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404059 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404143 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404362 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404447 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404665 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404749 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.404972 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405064 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405371 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405582 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405666 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405891 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.405984 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406194 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406316 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406503 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406619 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406834 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.406928 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407178 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407271 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407487 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407572 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407800 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.407892 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408122 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408207 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408434 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408561 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408748 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.408834 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409058 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409141 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409363 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409449 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409676 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409769 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.409985 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410078 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410299 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410390 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410624 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410705 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.410930 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.411006 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.411233 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.411308 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.412300 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.412384 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.412624 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.412700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.412969 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413121 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413250 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413374 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413571 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413832 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.413963 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414168 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414304 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414481 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414629 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414817 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.414914 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415128 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415213 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415437 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415521 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415747 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.415830 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416060 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416144 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416370 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416453 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416679 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416771 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.416991 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417075 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417297 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417389 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417607 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417699 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.417916 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418000 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418222 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418312 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418533 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418697 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418868 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.418953 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419172 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419263 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419485 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419578 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419793 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.419894 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420097 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420181 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420403 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420495 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420714 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.420835 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421028 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421148 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421333 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421460 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421764 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.421858 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422072 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422163 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422382 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422468 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422722 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.422857 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423036 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423132 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423345 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423437 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423665 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423753 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.423980 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424066 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424288 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424374 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424661 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.424970 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425064 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425276 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425368 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425588 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425673 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425897 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.425989 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426203 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426506 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426638 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426837 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.426936 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.427170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.427858 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428014 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428098 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428318 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428414 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428642 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428772 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.428949 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.429041 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.429273 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.429366 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.429689 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.429818 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430002 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430088 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430307 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430393 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430753 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.430844 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431068 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431168 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431380 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431502 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431707 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.431800 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432020 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432104 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432334 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432419 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432641 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432728 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.432954 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433040 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433266 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433351 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433579 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433671 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433887 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.433972 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434201 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434293 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434517 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434631 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434847 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.434932 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435170 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435264 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435493 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435577 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435809 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.435902 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436135 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436231 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436508 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436675 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436835 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.436922 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437144 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437238 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437454 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437539 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437766 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.437851 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438073 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438159 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438379 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438464 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438715 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.438847 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439023 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439110 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439328 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439412 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439634 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439738 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.439946 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440035 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440250 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440334 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440558 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440644 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440870 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.440955 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441175 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441260 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441477 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441570 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441800 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.441892 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442107 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442199 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442427 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442519 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442775 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.442866 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443107 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443193 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443418 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443513 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443722 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.443806 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444026 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444110 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444336 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444430 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444638 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444722 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.444944 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445041 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445249 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445338 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445591 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445677 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445897 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.445983 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.446216 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.446302 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.446564 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.446651 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.446900 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447001 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447208 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447293 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447522 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447606 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447843 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.447940 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448159 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448242 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448464 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448548 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448771 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.448862 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449084 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449389 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449473 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449693 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449786 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.449999 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450084 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450303 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450393 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450629 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450736 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.450936 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451028 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451240 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451324 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451542 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451634 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451846 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.451939 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452155 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452319 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452461 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452547 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452764 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.452849 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453066 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453196 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453371 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453463 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453674 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453758 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.453978 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454072 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454280 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454367 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454642 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454730 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.454953 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455048 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455269 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455361 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455581 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455672 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455894 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.455986 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456211 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456296 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456523 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456615 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456834 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.456926 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457147 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457230 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457454 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457538 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457764 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.457856 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.458079 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.458199 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.458921 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459018 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459235 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459443 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459552 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459773 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.459858 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.460089 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.460387 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.460474 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.460703 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.460788 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461018 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461102 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461333 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461420 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461645 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461730 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.461956 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462040 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462269 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462356 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462597 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462686 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.462916 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463012 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463226 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463312 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463537 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463622 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.463864 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464004 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464181 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464267 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464498 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464591 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464819 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.464919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465135 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465220 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465448 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465532 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465761 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.465854 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466077 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466163 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466390 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466496 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466730 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.466819 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467045 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467140 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467357 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467535 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467735 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.467820 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468051 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468136 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468366 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468464 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468679 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468765 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.468990 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469076 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469302 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469395 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469615 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469700 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.469926 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470011 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470240 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470326 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470576 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470676 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470888 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.470973 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.471204 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.471291 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.471520 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.471605 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.471833 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472039 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472134 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472355 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472440 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472688 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.472953 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473046 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473271 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473403 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473607 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473692 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.473933 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.474044 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.474833 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.474936 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475144 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475237 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475451 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475545 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475763 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.475849 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476074 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476159 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476380 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476474 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476688 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.476772 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477000 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477302 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477395 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477621 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477707 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.477929 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478020 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478233 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478463 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478573 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478838 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.478923 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.479154 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.479394 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.479481 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.479749 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.479841 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480067 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480161 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480392 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480484 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480717 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.480802 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481025 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481123 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481332 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481418 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481650 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481737 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.481957 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482049 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482261 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482356 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482590 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482679 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.482908 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483004 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483266 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483372 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483511 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483601 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483816 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.483903 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484121 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484206 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484509 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484737 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.484824 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485042 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485126 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485395 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485488 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485659 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485754 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.485964 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486049 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486268 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486360 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486594 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486681 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.486905 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487004 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487210 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487320 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487513 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487597 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487816 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.487901 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488118 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488219 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488422 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488519 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488734 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.488828 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489039 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489133 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489352 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489444 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489693 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.489788 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490003 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490097 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490308 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490400 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490650 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490746 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.490960 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491047 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491271 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491356 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491580 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491672 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491891 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.491977 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.492215 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.492301 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.492527 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.492613 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.492839 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.493062 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.493184 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.493401 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.493487 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.493727 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494021 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494108 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494353 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494447 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494709 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.494809 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495024 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495140 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495337 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495473 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495665 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495783 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.495978 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496090 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496295 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496381 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496609 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496702 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.496921 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497005 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497233 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497326 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497544 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497640 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497856 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.497941 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498166 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498250 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498476 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498581 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498810 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.498904 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499120 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499216 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499431 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499524 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499738 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.499822 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500046 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500130 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500354 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500663 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500752 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.500974 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501068 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501296 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501381 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501613 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501699 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.501939 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502032 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502252 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502336 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502696 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502896 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.502995 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503205 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503291 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503512 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503596 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503822 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.503916 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.504129 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.504222 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.504433 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.504518 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.504757 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.505071 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.505155 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.505412 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.505501 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.505749 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506075 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506161 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506388 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506472 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.506835 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507057 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507142 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507368 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507459 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507687 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507785 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.507999 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508085 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508308 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508394 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508629 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508723 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.508941 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509042 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509272 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509364 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509576 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509662 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509885 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.509970 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510194 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510506 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510643 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510845 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.510931 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511156 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511241 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511463 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511557 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511766 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.511851 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512076 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512171 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512379 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512463 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512683 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512767 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.512985 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513084 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513286 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513371 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513592 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513676 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513893 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.513994 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514193 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514278 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514495 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514596 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514822 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.514918 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515124 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515211 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515425 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515509 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515724 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.515816 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516024 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516108 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516324 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516408 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516626 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516712 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.516924 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517015 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517226 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517311 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517526 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517620 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517826 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.517920 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518126 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518211 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518458 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518563 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518817 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.518905 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519134 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519228 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519441 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519527 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519756 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.519848 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520077 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520383 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520467 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520693 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.520778 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.521533 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.521699 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.521844 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.521931 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522155 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522240 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522468 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522600 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522804 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.522907 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523115 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523201 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523425 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523513 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523733 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.523817 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524046 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524141 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524354 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524441 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524678 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524771 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.524997 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525083 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525304 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525397 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525628 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525721 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.525943 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526036 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526263 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526348 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526590 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526679 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.526904 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527000 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527214 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527299 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527528 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527622 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527838 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.527931 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528146 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528239 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528456 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528548 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528764 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.528860 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529082 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529174 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529398 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529528 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529711 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.529805 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530028 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530113 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530342 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530425 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530690 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.530777 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531019 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531128 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531325 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531411 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531659 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531757 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.531986 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532071 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532317 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532410 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532631 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532715 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.532942 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.533027 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.533252 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.533345 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.533496 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 19:05:47.533589 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.533890 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.534197 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:05:47.534440 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 19:05:47.686517 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO dbcounter [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Registered counter for database nova_api Sep 07 19:05:47.686851 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO dbcounter [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Registered counter for database nova_api Sep 07 19:05:47.708128 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_db.sqlalchemy.engines [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.711891 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_db.sqlalchemy.engines [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.715222 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writer thread running {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.718399 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writer thread running {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.772161 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.context [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830cd0e6-a124-4034-b556-b105279cb03a(cell1) {{(pid=106049) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 19:05:47.774603 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.context [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830cd0e6-a124-4034-b556-b105279cb03a(cell1) {{(pid=106048) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 19:05:47.776110 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:05:47.776580 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:05:47.778162 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:05:47.778575 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:05:47.778905 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:05:47.779052 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:05:47.779347 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:05:47.780616 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:05:47.781314 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:05:47.781414 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:05:47.781755 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:05:47.783324 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO dbcounter [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Registered counter for database nova_cell0 Sep 07 19:05:47.783757 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_concurrency.lockutils [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:05:47.785715 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO dbcounter [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Registered counter for database nova_cell0 Sep 07 19:05:47.788126 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO dbcounter [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Registered counter for database nova_cell1 Sep 07 19:05:47.790410 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO dbcounter [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Registered counter for database nova_cell1 Sep 07 19:05:47.795606 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_db.sqlalchemy.engines [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.798196 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_db.sqlalchemy.engines [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.799360 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_db.sqlalchemy.engines [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.800885 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_db.sqlalchemy.engines [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.803229 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writer thread running {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.808438 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writer thread running {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.809925 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writer thread running {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.940164 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writer thread running {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.949818 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO dbcounter [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Registered counter for database nova_cell0 Sep 07 19:05:47.954384 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO dbcounter [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Registered counter for database nova_cell0 Sep 07 19:05:47.956923 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_db.sqlalchemy.engines [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.961828 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writer thread running {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:47.963025 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG oslo_db.sqlalchemy.engines [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:05:47.967713 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writer thread running {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:05:48.387659 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: WARNING keystonemiddleware.auth_token [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:05:48.395073 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: WARNING keystonemiddleware.auth_token [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:05:48.436188 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: WARNING keystonemiddleware.auth_token [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:05:48.444104 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: WARNING keystonemiddleware.auth_token [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:05:48.736754 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: WARNING keystonemiddleware.auth_token [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:05:48.742779 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: WARNING keystonemiddleware.auth_token [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:05:48.748061 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d08b669c0 pid: 106049 (default app) Sep 07 19:05:48.750139 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:05:48.751337 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001748 Sep 07 19:05:48.751754 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Wed Sep 7 19:05:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:05:48.786436 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: WARNING keystonemiddleware.auth_token [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:05:48.792688 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: WARNING keystonemiddleware.auth_token [None req-3867485b-be4b-47e5-912d-c2c8728178e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:05:48.798067 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557d08b669c0 pid: 106048 (default app) Sep 07 19:07:12.651058 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:12.652175 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 07 19:07:12.654013 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:12.670416 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_api:SELECT=3 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:12.672279 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_cell1:SELECT=3 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:12.673200 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_cell0:SELECT=3 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:12.674260 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:13.584850 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-f94bcee1-016a-4868-a245-baabebd1cebe admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:13.622186 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-f94bcee1-016a-4868-a245-baabebd1cebe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.962169 Sep 07 19:07:13.622970 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Wed Sep 7 19:07:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:16.226979 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:16.227985 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-d9088951-ec68-4a1b-8e86-5f3c4d113cd9 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 07 19:07:16.228552 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:16.705406 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-2407d451-1c72-4cd5-a78a-4aa9d1bc6a5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:16.828641 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-2407d451-1c72-4cd5-a78a-4aa9d1bc6a5e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.594111 Sep 07 19:07:16.829215 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:16.842989 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_api:SELECT=3 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:16.843950 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_cell0:SELECT=3 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:16.846371 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_cell1:SELECT=3 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:16.846753 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:17.055722 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-354413a0-6fa3-4b6f-9791-76aa3bdd578f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:17.203813 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-354413a0-6fa3-4b6f-9791-76aa3bdd578f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366144 Sep 07 19:07:17.204411 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Wed Sep 7 19:07:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:19.824246 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-2407d451-1c72-4cd5-a78a-4aa9d1bc6a5e admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:19.825277 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-2407d451-1c72-4cd5-a78a-4aa9d1bc6a5e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 07 19:07:19.825688 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:20.480051 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-e40eccbc-a1fc-43eb-9275-5d670fc3dd34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "ds512M", "disk": 5}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:20.609743 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-e40eccbc-a1fc-43eb-9275-5d670fc3dd34 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777694 Sep 07 19:07:20.610718 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:20.622900 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-76ddf44f-aac2-4689-be02-f26344e1ee87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:20.748526 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-76ddf44f-aac2-4689-be02-f26344e1ee87 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129158 Sep 07 19:07:20.749208 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Wed Sep 7 19:07:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:23.355047 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-e40eccbc-a1fc-43eb-9275-5d670fc3dd34 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:23.356063 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-e40eccbc-a1fc-43eb-9275-5d670fc3dd34 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 07 19:07:23.356637 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:23.778944 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-d9cc096c-9f84-4184-935d-fb5329d227ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "vcpus": 1, "id": "d2", "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:23.887028 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-d9cc096c-9f84-4184-935d-fb5329d227ec admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.523503 Sep 07 19:07:23.887584 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:23.899588 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-f024e0b1-16c1-4d21-a446-8315936d922d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:23.983487 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-f024e0b1-16c1-4d21-a446-8315936d922d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087495 Sep 07 19:07:23.984064 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Wed Sep 7 19:07:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:26.665566 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-d9cc096c-9f84-4184-935d-fb5329d227ec admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:26.666757 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-d9cc096c-9f84-4184-935d-fb5329d227ec admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 07 19:07:26.667158 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:27.117222 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-63bb4309-afb4-499b-86b6-bfeb68a2eae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:27.203223 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-63bb4309-afb4-499b-86b6-bfeb68a2eae8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529789 Sep 07 19:07:27.203837 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:27.218260 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-fcd84150-7825-49a2-9d3b-4572f70c86ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:27.294237 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-fcd84150-7825-49a2-9d3b-4572f70c86ca admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079624 Sep 07 19:07:27.295245 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Wed Sep 7 19:07:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:29.973707 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-63bb4309-afb4-499b-86b6-bfeb68a2eae8 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:29.974759 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-63bb4309-afb4-499b-86b6-bfeb68a2eae8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 07 19:07:29.975167 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:07:30.467942 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:30.549986 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.568001 Sep 07 19:07:30.550466 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:07:30.562503 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-6391af8c-3fed-467a-a4b8-6ee326d6dd1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:30.641476 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-6391af8c-3fed-467a-a4b8-6ee326d6dd1b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082703 Sep 07 19:07:30.642053 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Wed Sep 7 19:07:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:33.959208 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:33.960231 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Sep 07 19:07:33.960640 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:34.472258 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-bd91d7fb-637d-433b-988a-0f61540d0083 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:34.497548 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-bd91d7fb-637d-433b-988a-0f61540d0083 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.530497 Sep 07 19:07:34.497972 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Wed Sep 7 19:07:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:07:37.059203 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:37.060171 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-d0ed94b5-6c83-4f2d-9131-9a63e7f2b02a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 07 19:07:37.060576 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:37.457478 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0be45470-37e0-4d88-b0db-37735cdaf311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:37.547948 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-0be45470-37e0-4d88-b0db-37735cdaf311 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480308 Sep 07 19:07:37.548502 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:37.560911 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-5c732cab-428f-410a-a470-bed57a7835a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:37.652131 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-5c732cab-428f-410a-a470-bed57a7835a4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094798 Sep 07 19:07:37.652711 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Wed Sep 7 19:07:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:40.265699 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0be45470-37e0-4d88-b0db-37735cdaf311 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:40.266763 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-0be45470-37e0-4d88-b0db-37735cdaf311 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 07 19:07:40.272154 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:40.719702 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-adcce02e-1b79-4f32-ad59-63d9a8f2347d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:40.808771 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-adcce02e-1b79-4f32-ad59-63d9a8f2347d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535296 Sep 07 19:07:40.809245 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:40.822034 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-4ea629ea-ba92-4870-a62b-3934c9483206 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:40.903874 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-4ea629ea-ba92-4870-a62b-3934c9483206 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085569 Sep 07 19:07:40.904487 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Wed Sep 7 19:07:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:07:43.574946 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-adcce02e-1b79-4f32-ad59-63d9a8f2347d admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:43.576583 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-adcce02e-1b79-4f32-ad59-63d9a8f2347d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Sep 07 19:07:43.576980 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:44.009325 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-4a1bddc4-65e2-4287-9492-34268584fbe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "disk": 40, "id": "3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:44.088804 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-4a1bddc4-65e2-4287-9492-34268584fbe7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.504946 Sep 07 19:07:44.090694 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:44.101707 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-9d9ad1ff-bd01-4fbe-a2fd-40671338d77f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:44.107141 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:44.201508 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-9d9ad1ff-bd01-4fbe-a2fd-40671338d77f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103619 Sep 07 19:07:44.204179 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Wed Sep 7 19:07:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:46.844956 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-4a1bddc4-65e2-4287-9492-34268584fbe7 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:46.847410 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-4a1bddc4-65e2-4287-9492-34268584fbe7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002844 Sep 07 19:07:46.848449 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:47.280907 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-7bcf9452-ca91-4401-b241-2833618d70b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "id": "4"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:47.355708 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-7bcf9452-ca91-4401-b241-2833618d70b9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501474 Sep 07 19:07:47.356610 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:47.369137 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-4b9231a4-5945-469d-802e-e5b3d58844fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:47.450329 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-4b9231a4-5945-469d-802e-e5b3d58844fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084735 Sep 07 19:07:47.451249 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Wed Sep 7 19:07:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:07:50.165550 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-7bcf9452-ca91-4401-b241-2833618d70b9 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:07:50.167271 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-7bcf9452-ca91-4401-b241-2833618d70b9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Sep 07 19:07:50.167671 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:07:50.725586 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:50.733144 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:07:50.842456 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.667859 Sep 07 19:07:50.843057 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Wed Sep 7 19:07:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:07:50.855725 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-df9b88b7-5f22-4660-8fd1-f2279e3d1b70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:07:50.946943 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-df9b88b7-5f22-4660-8fd1-f2279e3d1b70 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094777 Sep 07 19:07:50.947755 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Wed Sep 7 19:07:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:08:06.838054 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:06.839109 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 07 19:08:06.839509 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:08:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:06.850284 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:08:07.227151 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-51a3bd5d-9ed1-4ae2-99a4-82d5000cc864 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:07.245070 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-51a3bd5d-9ed1-4ae2-99a4-82d5000cc864 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399169 Sep 07 19:08:07.245604 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Wed Sep 7 19:08:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:08.539866 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:08.540858 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-360d6fb2-7548-4a04-93fc-5bf9ab5d12ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 07 19:08:08.541275 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:09.059827 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-30d44024-f31a-4c28-9831-b866f6e42994 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:09.065604 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.wsgi [None req-30d44024-f31a-4c28-9831-b866f6e42994 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-30d44024-f31a-4c28-9831-b866f6e42994 admin admin] Request method failure captured: Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept: application/json Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept-Encoding: gzip, deflate Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Connection: keep-alive Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Content-Length: 0 Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Host: 10.222.0.46 Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-System-Scope: None Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: User-Agent: python-novaclient Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Auth-Token: gAAAAABjGOwYtNZ-cuSXbGkTboxgXWrVcVJkbIEgj9zUq5EvFpWGcPZRkSTuVrQGtq2RQjdPxKzATCjLulZqv3QD0IdtLPlduzxhWHJsqdO_mrLTbsiojv1MexlNTtP3RdPFj5W9a2H1lEMVak0AgvxDNqPu908N4V0uSrTQzti2p-RgpbdNXOQ Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Id: None Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Name: None Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Identity-Status: Confirmed Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Is-Admin-Project: True Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Id: default Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Name: Default Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Name: admin Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Role: member,admin,reader Sep 07 19:08:09.068882 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Roles: member,admin,reader Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant: admin Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Name: admin Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User: admin Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Id: default Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Name: Default Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Name: admin Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: method: > Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: exception: Flavor 42 could not be found. Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: action_args: {'id': '42'} Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:09.070442 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:09.071516 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.072872 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-30d44024-f31a-4c28-9831-b866f6e42994 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:09.074158 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-30d44024-f31a-4c28-9831-b866f6e42994 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392871 Sep 07 19:08:09.074158 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Sep 7 19:08:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:09.080642 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-6dfdd2c2-fbf7-4fd0-9d0b-7f918a33c384 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:09.102336 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-6dfdd2c2-fbf7-4fd0-9d0b-7f918a33c384 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025886 Sep 07 19:08:09.107386 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:09.113429 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-423f0c85-706e-4a24-85e1-2725f2155fd4 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:09.135225 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-423f0c85-706e-4a24-85e1-2725f2155fd4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026385 Sep 07 19:08:09.135801 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:09.145552 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d200722d-8c00-46f9-8025-21d1304f9b4b admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:09.151268 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.wsgi [None req-d200722d-8c00-46f9-8025-21d1304f9b4b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d200722d-8c00-46f9-8025-21d1304f9b4b admin admin] Request method failure captured: Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept: application/json Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept-Encoding: gzip, deflate Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Connection: keep-alive Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Content-Length: 0 Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Host: 10.222.0.46 Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-System-Scope: None Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: User-Agent: python-novaclient Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Auth-Token: gAAAAABjGOwYtNZ-cuSXbGkTboxgXWrVcVJkbIEgj9zUq5EvFpWGcPZRkSTuVrQGtq2RQjdPxKzATCjLulZqv3QD0IdtLPlduzxhWHJsqdO_mrLTbsiojv1MexlNTtP3RdPFj5W9a2H1lEMVak0AgvxDNqPu908N4V0uSrTQzti2p-RgpbdNXOQ Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Id: None Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Name: None Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Identity-Status: Confirmed Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Is-Admin-Project: True Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Id: default Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Name: Default Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Name: admin Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Role: member,admin,reader Sep 07 19:08:09.154462 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Roles: member,admin,reader Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant: admin Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Name: admin Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User: admin Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Id: default Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Name: Default Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Name: admin Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: method: > Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: exception: Flavor 42 could not be found. Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: action_args: {'id': '42'} Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:09.156170 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:09.157424 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:09.158735 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-d200722d-8c00-46f9-8025-21d1304f9b4b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:09.161255 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-d200722d-8c00-46f9-8025-21d1304f9b4b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013834 Sep 07 19:08:09.161255 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Sep 7 19:08:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:10.381677 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-423f0c85-706e-4a24-85e1-2725f2155fd4 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:10.382718 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-423f0c85-706e-4a24-85e1-2725f2155fd4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 07 19:08:10.383122 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:10.903834 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-e8698181-9fbf-40d6-90ea-26ec1e2549b7 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:10.908823 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.wsgi [None req-e8698181-9fbf-40d6-90ea-26ec1e2549b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-e8698181-9fbf-40d6-90ea-26ec1e2549b7 admin admin] Request method failure captured: Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept: application/json Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept-Encoding: gzip, deflate Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Connection: keep-alive Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Content-Length: 0 Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Host: 10.222.0.46 Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-System-Scope: None Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: User-Agent: python-novaclient Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Auth-Token: gAAAAABjGOwa0v0NyXx0TVvbgAeYMJxck4Lk9KcbUMgUu5tfNGG1Nbmz63Z6SbDJtwzdXk2WloZ40PkeG25DWrCcVmigl5bPjIBbjKQUR5fzRRJG48e9qHkohayEU--QM4v1GeMgP4sxwFwao8PodrI-okClOhi58pfn1WyAyyZ8H-2Oo0Sr9RM Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Id: None Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Name: None Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Identity-Status: Confirmed Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Is-Admin-Project: True Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Id: default Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Name: Default Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Name: admin Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Role: member,admin,reader Sep 07 19:08:10.910312 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Roles: member,admin,reader Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant: admin Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Name: admin Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User: admin Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Id: default Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Name: Default Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Name: admin Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: method: > Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: exception: Flavor 84 could not be found. Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: action_args: {'id': '84'} Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:10.911898 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:10.913279 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.914700 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-e8698181-9fbf-40d6-90ea-26ec1e2549b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:10.915927 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-e8698181-9fbf-40d6-90ea-26ec1e2549b7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391620 Sep 07 19:08:10.915927 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Sep 7 19:08:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:10.921698 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-8b40aa17-95f9-4037-90f5-dc7c94ef8e14 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:10.936864 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-8b40aa17-95f9-4037-90f5-dc7c94ef8e14 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018803 Sep 07 19:08:10.937393 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:10.946935 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-b8c02a4c-ec19-4a7c-ae92-3da7ab57de02 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:10.961863 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-b8c02a4c-ec19-4a7c-ae92-3da7ab57de02 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018318 Sep 07 19:08:10.962366 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:10.971290 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-41d57c51-cebe-4468-b1be-994290688048 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:10.976116 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.wsgi [None req-41d57c51-cebe-4468-b1be-994290688048 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-41d57c51-cebe-4468-b1be-994290688048 admin admin] Request method failure captured: Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept: application/json Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept-Encoding: gzip, deflate Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Connection: keep-alive Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Content-Length: 0 Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Host: 10.222.0.46 Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-System-Scope: None Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: User-Agent: python-novaclient Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Auth-Token: gAAAAABjGOwa0v0NyXx0TVvbgAeYMJxck4Lk9KcbUMgUu5tfNGG1Nbmz63Z6SbDJtwzdXk2WloZ40PkeG25DWrCcVmigl5bPjIBbjKQUR5fzRRJG48e9qHkohayEU--QM4v1GeMgP4sxwFwao8PodrI-okClOhi58pfn1WyAyyZ8H-2Oo0Sr9RM Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Id: None Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Name: None Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Identity-Status: Confirmed Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Is-Admin-Project: True Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Id: default Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Name: Default Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Name: admin Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Role: member,admin,reader Sep 07 19:08:10.977605 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Roles: member,admin,reader Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant: admin Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Name: admin Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User: admin Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Id: default Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Name: Default Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Name: admin Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: method: > Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: exception: Flavor 84 could not be found. Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: action_args: {'id': '84'} Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:10.979120 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:10.980086 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:10.981256 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-41d57c51-cebe-4468-b1be-994290688048 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:10.982285 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-41d57c51-cebe-4468-b1be-994290688048 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011173 Sep 07 19:08:10.982285 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Sep 7 19:08:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:12.189450 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-b8c02a4c-ec19-4a7c-ae92-3da7ab57de02 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:12.190449 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-b8c02a4c-ec19-4a7c-ae92-3da7ab57de02 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 07 19:08:12.190870 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:12.707386 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-a10b45a1-6b2a-4b40-b8dd-340ef86bbbd8 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:12.713229 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.wsgi [None req-a10b45a1-6b2a-4b40-b8dd-340ef86bbbd8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-a10b45a1-6b2a-4b40-b8dd-340ef86bbbd8 admin admin] Request method failure captured: Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept: application/json Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Accept-Encoding: gzip, deflate Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Connection: keep-alive Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Content-Length: 0 Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Host: 10.222.0.46 Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Openstack-System-Scope: None Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: User-Agent: python-novaclient Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Auth-Token: gAAAAABjGOwcTuBRUoaEVCe24kJCWUpS2UBOeY0dcbfcXpTNw21YmQqPhHqBHNUp6VyrAHKfmQ77TDayhWFXnQ4Lr2gMm68oMXNc2AirVRtUFdSLdxdUSNlKr6J939PdanWvcV6dxDfNAz_RNreMcqMi20O6VoTY8jIEMKDG34TZfbkY3_0wK7k Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Id: None Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Domain-Name: None Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Identity-Status: Confirmed Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Is-Admin-Project: True Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Id: default Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Domain-Name: Default Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Project-Name: admin Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Role: member,admin,reader Sep 07 19:08:12.714762 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Roles: member,admin,reader Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant: admin Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-Tenant-Name: admin Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User: admin Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Id: default Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Domain-Name: Default Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: X-User-Name: admin Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: method: > Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: exception: Flavor 451 could not be found. Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: action_args: {'id': '451'} Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:12.716294 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:12.717439 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.718897 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-a10b45a1-6b2a-4b40-b8dd-340ef86bbbd8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:12.720157 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-a10b45a1-6b2a-4b40-b8dd-340ef86bbbd8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390534 Sep 07 19:08:12.720157 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:08:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:12.725848 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-bb316afa-b1e4-4434-bc05-82469a5e4b8d admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:12.740561 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-bb316afa-b1e4-4434-bc05-82469a5e4b8d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018222 Sep 07 19:08:12.741068 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:12.750683 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:12.765315 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018700 Sep 07 19:08:12.766466 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Sep 7 19:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:08:12.775443 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0d1717ce-8003-4004-8ba9-452b8c745da3 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:12.780347 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.wsgi [None req-0d1717ce-8003-4004-8ba9-452b8c745da3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0d1717ce-8003-4004-8ba9-452b8c745da3 admin admin] Request method failure captured: Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept: application/json Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Accept-Encoding: gzip, deflate Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Connection: keep-alive Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Content-Length: 0 Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Host: 10.222.0.46 Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-Api-Version: compute 2.92 Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Openstack-System-Scope: None Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: User-Agent: python-novaclient Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Auth-Token: gAAAAABjGOwcTuBRUoaEVCe24kJCWUpS2UBOeY0dcbfcXpTNw21YmQqPhHqBHNUp6VyrAHKfmQ77TDayhWFXnQ4Lr2gMm68oMXNc2AirVRtUFdSLdxdUSNlKr6J939PdanWvcV6dxDfNAz_RNreMcqMi20O6VoTY8jIEMKDG34TZfbkY3_0wK7k Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Id: None Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Domain-Name: None Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Identity-Status: Confirmed Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Is-Admin-Project: True Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Id: default Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Domain-Name: Default Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Project-Name: admin Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Role: member,admin,reader Sep 07 19:08:12.781919 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Roles: member,admin,reader Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0eeffadf972f483fb4e32d2c25b5e94c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant: admin Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Id: 0eeffadf972f483fb4e32d2c25b5e94c Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-Tenant-Name: admin Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User: admin Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Id: default Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Domain-Name: Default Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Id: bc4a17a3aa754cf9b61c2b367071735b Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: X-User-Name: admin Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: method: > Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: exception: Flavor 451 could not be found. Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: action_args: {'id': '451'} Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:08:12.783480 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:12.784457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: ERROR nova.api.openstack.wsgi Sep 07 19:08:12.785752 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0d1717ce-8003-4004-8ba9-452b8c745da3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:08:12.786995 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-0d1717ce-8003-4004-8ba9-452b8c745da3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011285 Sep 07 19:08:12.786995 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:08:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 19:08:13.993719 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:13.994756 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 07 19:08:13.995146 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:14.518829 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-19c387cb-2400-442d-a26a-854416bd21b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:08:14.589391 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-19c387cb-2400-442d-a26a-854416bd21b7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.457105 Sep 07 19:08:14.589939 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Sep 7 19:08:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:08:15.812284 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:15.813634 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001783 Sep 07 19:08:15.814028 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:16.346376 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-ddf6d9c7-6d81-4a74-88bf-c93e094d2410 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:08:16.432886 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-ddf6d9c7-6d81-4a74-88bf-c93e094d2410 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.482618 Sep 07 19:08:16.433427 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Sep 7 19:08:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:08:17.666742 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:17.667778 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 07 19:08:17.668174 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:18.191603 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0f3df8d9-48c4-4242-9097-2905a40fcfe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:08:18.270935 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-0f3df8d9-48c4-4242-9097-2905a40fcfe7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.465557 Sep 07 19:08:18.271486 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Sep 7 19:08:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:08:19.491451 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:19.492400 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 07 19:08:19.492789 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:20.014976 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-7d0ad0c5-a9fb-4be4-bd1d-3a287c486c9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:08:20.118710 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-7d0ad0c5-a9fb-4be4-bd1d-3a287c486c9e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.488084 Sep 07 19:08:20.119262 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Sep 7 19:08:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:08:21.330219 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:21.331259 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 07 19:08:21.331658 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:08:21.847899 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-bfda039e-93dd-4f9a-ad5c-ff08012a9340 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:08:21.868698 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-bfda039e-93dd-4f9a-ad5c-ff08012a9340 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402463 Sep 07 19:08:21.869232 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Wed Sep 7 19:08:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:09:18.462596 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.463627 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-ec670db5-864d-4e0c-856d-9a11a7e90454 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 07 19:09:18.464017 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:09:18.474411 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:09:18.866243 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-9f91d309-d3e5-4318-a48f-f073a02923ec admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.886501 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-9f91d309-d3e5-4318-a48f-f073a02923ec admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416497 Sep 07 19:09:18.887060 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:09:18.908894 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_api:SELECT=14 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:09:18.912845 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-690eaf4c-4d29-48fa-90a8-1ea88286d3d8 admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.920248 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-690eaf4c-4d29-48fa-90a8-1ea88286d3d8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012752 Sep 07 19:09:18.920767 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:09:18.932372 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-71a084da-c865-4d17-bb38-3fafbe996f15 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.939647 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-71a084da-c865-4d17-bb38-3fafbe996f15 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010897 Sep 07 19:09:18.940149 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:09:18.951034 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.958835 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011169 Sep 07 19:09:18.959346 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:09:18.970710 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-3c00e712-1152-45d3-933a-2434050bdaa1 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:09:18.977652 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-3c00e712-1152-45d3-933a-2434050bdaa1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010917 Sep 07 19:09:18.978159 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Wed Sep 7 19:09:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:12:28.470007 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:28.471065 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 07 19:12:28.471463 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:12:28.614925 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_api:SELECT=6 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:12:28.770595 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:28.775298 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:28.775763 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:28.776182 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:28.776880 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:28.777315 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:28.777749 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:28.809367 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-fc5329ff-bd62-4650-9319-696126b5960a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196167 Sep 07 19:12:28.809904 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:12:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:12:29.878524 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:29.879583 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 07 19:12:29.879996 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:12:30.068340 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:30.071874 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:30.072348 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:30.072778 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:30.073515 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:30.073953 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:30.074359 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:30.093763 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-0c5cc6e2-abbc-48c4-9f0d-459a1fa15b51 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075900 Sep 07 19:12:30.094299 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:12:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:12:41.585071 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:41.585641 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 07 19:12:41.585735 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:12:41.730662 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_cell0:SELECT=4 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:12:41.731378 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_cell1:SELECT=4 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:12:41.731993 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG dbcounter [-] [106049] Writing DB stats nova_api:SELECT=8 {{(pid=106049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:12:41.779770 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:41.783450 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:41.783918 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:41.784362 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:41.785114 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:41.786216 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:41.786716 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:41.812531 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-4c461931-7159-4e28-99e5-903f4b5875fc admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086278 Sep 07 19:12:41.813003 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:12:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:12:42.887129 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG nova.api.openstack.wsgi [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] Calling method '>' {{(pid=106048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:42.888142 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: INFO nova.api.openstack.requestlog [None req-47423a0a-87d5-488d-916f-71bdace43edc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 07 19:12:42.888755 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: [pid: 106048|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Sep 7 19:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:12:43.081976 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG nova.api.openstack.wsgi [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Calling method '>' {{(pid=106049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:12:43.085457 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:43.085923 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:43.086346 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:43.087099 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:12:43.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:12:43.087960 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: DEBUG oslo_concurrency.lockutils [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:12:43.110269 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: INFO nova.api.openstack.requestlog [None req-549fef3b-eb9d-4820-b4bb-92fee21cc0b0 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081094 Sep 07 19:12:43.110781 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: [pid: 106049|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Sep 7 19:12:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:13:41.060771 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: Wed Sep 7 19:13:41 2022 - graceful shutdown triggered... Sep 07 19:13:41.061266 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: Gracefully killing worker 1 (pid: 106048)... Sep 07 19:13:41.061660 dv-cinder-847732-5-iscsi devstack@n-api.service[106049]: Gracefully killing worker 2 (pid: 106049)... Sep 07 19:13:41.063079 dv-cinder-847732-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 19:13:41.187603 dv-cinder-847732-5-iscsi devstack@n-api.service[106048]: DEBUG dbcounter [-] [106048] Writing DB stats nova_api:SELECT=4 {{(pid=106048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:13:42.061348 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: worker 1 buried after 1 seconds Sep 07 19:13:42.061348 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: worker 2 buried after 1 seconds Sep 07 19:13:42.061348 dv-cinder-847732-5-iscsi devstack@n-api.service[106047]: goodbye to uWSGI. Sep 07 19:13:42.062805 dv-cinder-847732-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 19:13:42.063379 dv-cinder-847732-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 19:13:42.066879 dv-cinder-847732-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 19:13:42.076867 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 19:13:42 2022] *** Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: nodename: dv-cinder-847732-5-iscsi Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: machine: x86_64 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: clock source: unix Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: pcre jit disabled Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: detected number of CPU cores: 4 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: current working directory: / Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: detected binary path: /usr/bin/uwsgi-core Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: your processes number limit is 47680 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: your memory page size is 4096 bytes Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: detected max file descriptor number: 2048 Sep 07 19:13:42.079631 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: lock engine: pthread robust mutexes Sep 07 19:13:42.081204 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: thunder lock: enabled Sep 07 19:13:42.081204 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 19:13:42.081204 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 19:13:42.121228 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: Python main interpreter initialized at 0x559c37d289c0 Sep 07 19:13:42.121228 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: python threads support enabled Sep 07 19:13:42.121228 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: your server socket listen backlog is limited to 100 connections Sep 07 19:13:42.121228 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: your mercy for graceful operations on workers is 90 seconds Sep 07 19:13:42.121680 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 19:13:42.121680 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: *** Operational MODE: preforking *** Sep 07 19:13:42.121933 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: *** uWSGI is running in multiple interpreter mode *** Sep 07 19:13:42.121933 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: spawned uWSGI master process (pid: 121068) Sep 07 19:13:42.122139 dv-cinder-847732-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 19:13:42.122746 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: spawned uWSGI worker 1 (pid: 121079, cores: 1) Sep 07 19:13:42.123514 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: spawned uWSGI worker 2 (pid: 121080, cores: 1) Sep 07 19:13:42.123514 dv-cinder-847732-5-iscsi devstack@n-api.service[121068]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 19:13:42.793730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 19:13:42.800540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 19:13:43.980031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:13:43.980031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: from cryptography.utils import int_from_bytes Sep 07 19:13:43.980644 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:13:43.980644 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: from cryptography.utils import int_from_bytes Sep 07 19:13:43.981039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:13:43.981039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: from cryptography.utils import int_from_bytes Sep 07 19:13:43.981179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 19:13:43.981179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: from cryptography.utils import int_from_bytes Sep 07 19:13:46.422958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 19:13:46.424019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 19:13:46.424303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 19:13:46.424667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 19:13:46.424923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 19:13:46.425313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.425640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.425961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.426281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.426636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.426949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.427268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.427585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.427797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 19:13:46.428173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.428250 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 19:13:46.428338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.428507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.428605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 19:13:46.428905 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 19:13:46.429001 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-5-iscsi {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.429160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 19:13:46.429273 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.429524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.429632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.429988 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.430110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.430186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.430287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.430507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.430862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.431167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.431316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.431630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.431780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.431940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.432249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.432567 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.432936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.433177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.433396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.433616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.433829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.433829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.434248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847732-5-iscsi {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.434468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.434711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.434711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.435114 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.435114 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.435537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.435755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.435968 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.436173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.436379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.436379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.436797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.437014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.437227 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.437227 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-5-iscsi {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.437628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.437877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438301 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.438875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.439220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.439921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440076 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.440859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.441250 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.441411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.441556 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.441706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.441864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847732-5-iscsi {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442813 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.442963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443388 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.443872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444053 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444654 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.444950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445389 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.445990 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446450 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.446943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447834 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.447981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448135 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.448884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449026 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449548 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.449852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450322 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450652 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.450950 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451161 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.451945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.452964 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453402 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.453855 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454456 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.454926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.455785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456929 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.456929 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.457954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458387 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458757 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.458909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.459975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460122 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460561 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.460861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461010 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.461983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462132 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462733 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.462886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463041 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.463925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464217 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.464965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.465868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.466022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.466172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.466320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.466463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.467238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.467406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.467560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.467754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.467901 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.468994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.469869 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470016 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470478 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470845 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.470996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.471149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.471299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.471440 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.471828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.471987 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.472138 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.472291 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.472434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.472587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.473297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.473462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.473606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.473758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.473900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.474049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.474199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.474343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.474505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.474505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.474824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.474979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.475130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.475272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.475430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.475579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.475721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.475867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.476010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.476152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 19:13:46.476306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.476457 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.476614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.476756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.476915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477064 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.477832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.478853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479162 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.479906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.480934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.481077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.481218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.481359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.481508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.481683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482500 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.482998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483296 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483445 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483445 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.483993 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484609 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.484933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485236 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.485994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.486707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.486868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487160 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.487897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488046 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.488774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489362 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.489957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490529 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.490991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.491159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.491304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.491453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.491594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.491774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492753 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.492894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.493931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.494086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.494229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.494378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.494531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495141 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.495908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496777 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.496927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.497830 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.498959 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.499919 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500344 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.500938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.501088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.501241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.501383 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.501550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.501747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.502646 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.502797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.502941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503387 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.503982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.504136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.504286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.504444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.504591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.504734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.505277 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.505429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.505571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.505715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.505856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.506842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507001 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507310 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507594 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.507887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508457 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508607 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.508907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509049 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509803 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.509946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510244 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510409 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.510895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.511922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.512072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.512223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.512400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.512749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.512900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513051 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.513942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514410 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514767 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.514919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.515428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.515589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.515732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.515874 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516604 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.516906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.517971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.518902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519044 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.519938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520373 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.520980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.521908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.522062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.522218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.522367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.522752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.522934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523077 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523743 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.523960 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.524882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.525000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.525119 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.525768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.525898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.526929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527383 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.527940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528677 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.528918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529845 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.529956 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.530975 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.531938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.532062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.532173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.533591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.533723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.533850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.533964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534083 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534303 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.534919 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.535035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.535154 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.535266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.535836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.535972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536195 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536303 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.536977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537433 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537433 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.537941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538175 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.538935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539053 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539300 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539648 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.539999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540111 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.540927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541040 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541258 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.541960 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542190 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.542929 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.543941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.544991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.545103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.545213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.545330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.545442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.545973 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546721 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546721 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.546948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.547938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548056 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548056 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.548517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549736 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.549975 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.550885 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551165 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.551895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552014 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.552993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.553954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.554964 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.555648 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.556915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557848 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.557958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.558870 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559061 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559176 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559294 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.559950 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560256 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560723 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.560856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561438 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561646 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.561957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562076 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.562902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.563924 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.564049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.564771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.564900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.565096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.565213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.565419 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.565545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.565733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.566268 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.566482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.566711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.566831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.566941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567414 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567651 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.567891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568123 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.568904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569679 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.569997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570626 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.570935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571061 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.571976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572588 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.572893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573199 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573388 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.573969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574100 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574334 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574445 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.574873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575803 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.575923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.576447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.576581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.576581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.576802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.576802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.577823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578309 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.578949 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.579082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.579816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.580458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.580583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.580702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.580702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.580908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581128 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.581934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582647 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.582962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.583933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584592 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584822 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.584941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.585912 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.586201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.586816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.586938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587782 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.587900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.588939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589419 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589614 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.589928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590057 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.590897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.591946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.592904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.593882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594119 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.594910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.595023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.595141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.595253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.595390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.595996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.596189 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.596311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.596860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.596974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597070 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597442 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.597989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.598094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.598309 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.598410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.598694 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.598848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.599976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600116 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600402 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.600983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601298 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.601963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.602976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603173 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.603936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604571 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.604869 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605399 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605491 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.605795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.606853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.607658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.607769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.607857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.607943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608111 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.608987 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.609997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610197 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610540 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.610984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.611791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.611909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612744 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.612852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.613995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614103 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614307 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.614950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615888 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.615995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.616447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.616553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.616828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.616933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617846 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.617995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.618963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619538 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.619965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620512 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620843 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.620943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.621250 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.621586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.621914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.622256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.622672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.622948 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.623315 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.623633 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.623942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.624262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.624582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.624764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.624920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625481 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.625935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.626109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.626364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.626468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.627298 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.627613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.627755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.627928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.628254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.628356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.628589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.628685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.628910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629050 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.629858 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.630073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.630376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.630479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.630760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.630854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.631861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632705 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.632807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.633927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634033 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634901 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.634997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635481 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.635993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.636321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.636424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.636634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.636727 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.636948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.637989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638165 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638485 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638648 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638834 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.638938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639767 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.639869 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640664 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.640971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641065 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.641989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.642223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.642345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643135 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643439 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.643849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644056 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.644969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645071 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645373 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.645991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.646199 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.646301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.646508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.646651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.646902 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647555 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.647995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648180 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648492 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648584 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.648910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.649836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.650861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.651940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652689 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.652926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.653939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.654166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.654274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.654475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.654604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.654830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.655229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.655404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.655499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.655712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656633 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.656945 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657046 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657563 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.657982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658812 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.658909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659126 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.659889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660184 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.660810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.661946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662041 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662258 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.662938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663558 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.663982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664295 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664521 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.664942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665555 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.665874 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666184 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.666843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667818 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.667911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668566 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.668834 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669131 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.669961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670609 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.670921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671328 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.671999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672618 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.672931 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.673982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.674086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.674290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.674613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.674721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.674920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.675182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.675285 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.675508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.675773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.675875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.676134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.676359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.676454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.676766 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.676910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.677087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.677393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.677500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.677712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678114 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.678997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.679201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.679295 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.679617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.679748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.680003 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.680253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.680462 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.680774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.680881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.681166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.681307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.681477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.681785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.681879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.682147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.682352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.682669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.682907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.683018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.683375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.683469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.683696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.683969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.684071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.684321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.684585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.684694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.684983 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.685147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.685457 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.685755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.685856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.686112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.686357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.686459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.686832 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.686927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687462 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.687934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688378 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688703 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.688915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.689019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.689761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.689867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690180 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.690873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691191 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.691837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692666 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.692908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 19:13:46.693003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.693313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.693647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.693972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.694301 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.694649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.694969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.695304 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.695622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.695938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.696253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.696569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.696883 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.697203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.697518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.697831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.698153 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.698471 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.698839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.699170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.699485 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.699816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.700149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.700501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.700818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.701211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.701500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.701819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.702137 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.702448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 19:13:46.702720 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 19:13:46.754598 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Registered counter for database nova_api Sep 07 19:13:46.764773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Registered counter for database nova_api Sep 07 19:13:46.775467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.782618 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:46.786356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.793000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:46.839482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.context [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830cd0e6-a124-4034-b556-b105279cb03a(cell1) {{(pid=121079) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 19:13:46.843552 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:13:46.844033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:13:46.845684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:13:46.846437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:13:46.846915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:13:46.848915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:13:46.849495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.context [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),830cd0e6-a124-4034-b556-b105279cb03a(cell1) {{(pid=121080) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 19:13:46.851046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Registered counter for database nova_cell0 Sep 07 19:13:46.853519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:13:46.853997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:13:46.855171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Registered counter for database nova_cell1 Sep 07 19:13:46.855601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:13:46.856352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:13:46.856799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:13:46.858818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:13:46.860826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Registered counter for database nova_cell0 Sep 07 19:13:46.862663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.864960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.865382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Registered counter for database nova_cell1 Sep 07 19:13:46.869353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:46.872532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.874780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:46.879875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:47.011072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:47.020399 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:47.022018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO dbcounter [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Registered counter for database nova_cell0 Sep 07 19:13:47.028725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_db.sqlalchemy.engines [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:47.031093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO dbcounter [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Registered counter for database nova_cell0 Sep 07 19:13:47.038110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writer thread running {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:47.044228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 19:13:47.044228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writer thread running {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 19:13:47.359430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:13:47.365053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:13:47.367301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:13:47.372362 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:13:47.712203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:13:47.718150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: WARNING keystonemiddleware.auth_token [None req-2481dbe4-9ba8-45ed-962a-cf159244642b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:13:47.723514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c37d289c0 pid: 121079 (default app) Sep 07 19:13:47.724489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 19:13:47.730470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: WARNING keystonemiddleware.auth_token [None req-e7b4cfa7-b9b6-46c2-af59-1a9c69ebdbdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 19:13:47.737106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c37d289c0 pid: 121080 (default app) Sep 07 19:14:24.877369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:24.883702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:24.883702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:24.883702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:25.297910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:25.301375 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:25.310042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:25.311844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:26.319840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e629f53e-b5fd-4c64-9d34-97d2bcdcf368 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Action: 'create', calling method: .version_select at 0x7ff4db2d03a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-650489150"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:26.691787 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7e07a353-120c-4b7c-ad09-c5a47c90844f tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Action: 'create', calling method: .version_select at 0x7ff4db2d2430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-561779052", "metadata": {"Type": "work"}}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:29.096584 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e629f53e-b5fd-4c64-9d34-97d2bcdcf368 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.234125 Sep 07 19:14:29.097529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Sep 7 19:14:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4237 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 19:14:29.102676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f383103b-057b-4846-92fd-fc8e041a5d6a tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db1b3280>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:29.139963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7e07a353-120c-4b7c-ad09-c5a47c90844f tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.855984 Sep 07 19:14:29.143112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Sep 7 19:14:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3862 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 19:14:29.154104 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5804732e-5261-4a1e-8559-8826a2168138 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db1a1310>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:29.379541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f383103b-057b-4846-92fd-fc8e041a5d6a tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e5c25fd2-332d-4394-972b-fec329414ca2" status: 200 len: 351 microversion: 2.1 time: 0.280620 Sep 07 19:14:29.380284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:29 2022] GET /compute/v2.1/os-volumes/e5c25fd2-332d-4394-972b-fec329414ca2 => generated 351 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:29.386856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bbc3fc65-f4e6-4d5c-952b-a2419c99f353 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Calling method '.version_select at 0x7ff4db1b39d0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:29.671631 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5804732e-5261-4a1e-8559-8826a2168138 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 200 len: 344 microversion: 2.1 time: 0.527221 Sep 07 19:14:29.673332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:29 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 344 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:30.555163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bbc3fc65-f4e6-4d5c-952b-a2419c99f353 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096" status: 200 len: 353 microversion: 2.1 time: 1.173178 Sep 07 19:14:30.556143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:29 2022] GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 => generated 353 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:30.571045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6fb9a591-1086-483f-ba16-1e12962788b0 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Calling method '.version_select at 0x7ff4db1a1a60>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:30.687364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2ac6909-b8ec-4616-bc86-06fd3a6a4604 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db13d160>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:30.848983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6fb9a591-1086-483f-ba16-1e12962788b0 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096" status: 200 len: 353 microversion: 2.1 time: 0.282988 Sep 07 19:14:30.849797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:30 2022] GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 => generated 353 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:30.872827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c1b5efde-97c8-4948-ac70-de2803bf895a tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Calling method '.version_select at 0x7ff4db13f160>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:30.960219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2ac6909-b8ec-4616-bc86-06fd3a6a4604 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 200 len: 345 microversion: 2.1 time: 0.276934 Sep 07 19:14:30.961231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:30 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 345 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:30.977253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e707c905-4d80-495b-8c76-c0071489652f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Action: 'create', calling method: .version_select at 0x7ff4db1b3d30>, body: {"snapshot": {"volume_id": "32e09e6d-6178-4efc-a836-095633638870", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-871508625"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:31.192692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c1b5efde-97c8-4948-ac70-de2803bf895a tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096" status: 202 len: 0 microversion: 2.1 time: 0.328632 Sep 07 19:14:31.196083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:14:30 2022] DELETE /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:14:31.213157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-59a94b3b-3f1d-4afa-8c51-2563e804b264 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Calling method '.version_select at 0x7ff4db1a1d30>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:31.461841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-59a94b3b-3f1d-4afa-8c51-2563e804b264 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096" status: 200 len: 352 microversion: 2.1 time: 0.260251 Sep 07 19:14:31.462781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:31 2022] GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 => generated 352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:31.904004 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e707c905-4d80-495b-8c76-c0071489652f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.931132 Sep 07 19:14:31.908104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 5/10] 10.222.0.46 () {60 vars in 1162 bytes} [Wed Sep 7 19:14:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:31.921904 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e49c8b57-28ea-4d76-bb73-c32f263f1cd6 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db1a15e0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:32.112197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e49c8b57-28ea-4d76-bb73-c32f263f1cd6 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 286 microversion: 2.1 time: 0.197551 Sep 07 19:14:32.116655 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:31 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:32.118751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-068da074-14b8-4532-bf69-8fda922a729e tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db13d550>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:32.131122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9bcb4a7c-cc59-4a3a-8c0d-2a4e24110dd9 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db13f280>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:32.255801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-068da074-14b8-4532-bf69-8fda922a729e tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/833d8460-e4e3-47f9-b50d-d6b772d7f2f8" status: 200 len: 350 microversion: 2.1 time: 0.147875 Sep 07 19:14:32.268130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:32 2022] GET /compute/v2.1/os-volumes/833d8460-e4e3-47f9-b50d-d6b772d7f2f8 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:32.315792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9bcb4a7c-cc59-4a3a-8c0d-2a4e24110dd9 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.193167 Sep 07 19:14:32.317748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1140 bytes} [Wed Sep 7 19:14:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:32.329532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e56ea70c-e2e3-43bd-afcb-aae60cca1d24 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db13dca0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:32.485543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6645c844-5917-43e1-945e-44607a0102e2 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Calling method '.version_select at 0x7ff4db1a1550>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:33.181693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e56ea70c-e2e3-43bd-afcb-aae60cca1d24 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 286 microversion: 2.1 time: 0.856511 Sep 07 19:14:33.182911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:32 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 286 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:33.239715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-6645c844-5917-43e1-945e-44607a0102e2 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] HTTP exception thrown: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6645c844-5917-43e1-945e-44607a0102e2 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Request method failure captured: Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 HTTP/1.1 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2Ri5OngB78IVbTlS7lzmmddyWz75-EnGst7eQiZ9duNsFiid5VaFqZJYLA7nSkCK-huQLkMWct_kz4UJ8Nc-dpkG8MQDd2i3gKcGIjJ_Xf8U4uPjBW54hFX6KNLt-xF6ZcC4rav0u-lVdZ8PpQrOqhmu-B95aligQnN48ejB-X34M Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 8ae9ee69453a4104b735cf758efeff61 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesGetTestJSON-1310015288 Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:33.243964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8ae9ee69453a4104b735cf758efeff61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8ae9ee69453a4104b735cf758efeff61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ae9ee69453a4104b735cf758efeff61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8ae9ee69453a4104b735cf758efeff61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesGetTestJSON-1310015288 Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 8ae9ee69453a4104b735cf758efeff61 Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesGetTestJSON-1310015288 Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesGetTestJSON-1310015288-project Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f02bafa46fc6496796961af25a89910b Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesGetTestJSON-1310015288-project Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '0306b2de-fe9d-4ced-aa44-b0f20a75e096'} Sep 07 19:14:33.245048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. (HTTP 404) (Request-ID: req-f037d2f9-1b49-45a7-9e37-0ab48241fe65) Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:33.245668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:33.246654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 19:14:33.247612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6645c844-5917-43e1-945e-44607a0102e2 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] Returning 404 to user: Volume 0306b2de-fe9d-4ced-aa44-b0f20a75e096 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6645c844-5917-43e1-945e-44607a0102e2 tempest-VolumesGetTestJSON-1310015288 tempest-VolumesGetTestJSON-1310015288-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096" status: 404 len: 109 microversion: 2.1 time: 0.769175 Sep 07 19:14:33.248560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:32 2022] GET /compute/v2.1/os-volumes/0306b2de-fe9d-4ced-aa44-b0f20a75e096 => generated 109 bytes in 770 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:14:34.196039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b3ee04c-2e37-4a7d-887e-af6373abcbdf tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db1b3160>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:34.267495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b3ee04c-2e37-4a7d-887e-af6373abcbdf tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 286 microversion: 2.1 time: 0.075506 Sep 07 19:14:34.268213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:34 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:35.284120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a2406029-7ac0-4109-945e-d0bd4217f652 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4dbaff8b0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:35.353061 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a2406029-7ac0-4109-945e-d0bd4217f652 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 286 microversion: 2.1 time: 0.077031 Sep 07 19:14:35.353939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:35 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:36.366162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-96080120-a127-465b-937c-b85c99bbc497 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db1b3b80>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:36.446355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-96080120-a127-465b-937c-b85c99bbc497 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 287 microversion: 2.1 time: 0.084164 Sep 07 19:14:36.447042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:36 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:36.467836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-652f06e3-9467-41d3-9ade-5499a2274aa1 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db1a13a0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:36.699502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-652f06e3-9467-41d3-9ade-5499a2274aa1 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 202 len: 0 microversion: 2.1 time: 0.236287 Sep 07 19:14:36.700341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 10/19] 10.222.0.46 () {58 vars in 1254 bytes} [Wed Sep 7 19:14:36 2022] DELETE /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:14:36.709353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-42886c33-6853-4e1a-bd29-bbaeb067cee2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db121280>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:36.801366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-42886c33-6853-4e1a-bd29-bbaeb067cee2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 200 len: 286 microversion: 2.1 time: 0.096719 Sep 07 19:14:36.806634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:36 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:36.831011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7591cd3a-bc30-48cc-b7f4-2a3f3fc63e2a tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db121940>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:36.943484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7591cd3a-bc30-48cc-b7f4-2a3f3fc63e2a tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ef9d643b-9447-4923-8352-07d71600c6e8" status: 200 len: 351 microversion: 2.1 time: 0.117161 Sep 07 19:14:36.950962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 12/21] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:36 2022] GET /compute/v2.1/os-volumes/ef9d643b-9447-4923-8352-07d71600c6e8 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:36.959589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ef0ce677-ccb3-4856-87bb-c917cfcfd1ae tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db128040>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:37.231937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ef0ce677-ccb3-4856-87bb-c917cfcfd1ae tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.277071 Sep 07 19:14:37.243975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 13/22] 10.222.0.46 () {58 vars in 1134 bytes} [Wed Sep 7 19:14:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:37.253473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ef02d57-bf3b-4269-8874-958766fe12d3 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db121430>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:37.389102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-746351689", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:37.491826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ef02d57-bf3b-4269-8874-958766fe12d3 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.244416 Sep 07 19:14:37.493410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 14/23] 10.222.0.46 () {58 vars in 1149 bytes} [Wed Sep 7 19:14:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:37.509723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5519f314-4ffe-4dc6-9afa-3b724a41adeb tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4dbaff8b0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:37.607817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] validate_networks() for [('130327f0-428b-45b4-96e8-f00208541c08', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:14:37.653311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5519f314-4ffe-4dc6-9afa-3b724a41adeb tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.147253 Sep 07 19:14:37.654133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 15/24] 10.222.0.46 () {58 vars in 1134 bytes} [Wed Sep 7 19:14:37 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:37.669155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bd9fc55-3fb2-4588-8bff-c61675ad95d9 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db12eaf0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:37.807643 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7bd9fc55-3fb2-4588-8bff-c61675ad95d9 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.142969 Sep 07 19:14:37.808898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 16/25] 10.222.0.46 () {58 vars in 1167 bytes} [Wed Sep 7 19:14:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:37.832363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bd66775-e19b-4c37-9e79-7e2db6652e4f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4dbaff790>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:37.918619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-7bd66775-e19b-4c37-9e79-7e2db6652e4f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] HTTP exception thrown: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bd66775-e19b-4c37-9e79-7e2db6652e4f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Request method failure captured: Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e HTTP/1.1 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2Qt4tJJT5Lt9NLF6W9SDk1GjRdY5guZdVncOOMj3KB_rWUabVlaB9N7u4weJeyIWyFtOmxwLtjKKeNlwwQ9gVkAxbc1d46TQ-6IgCJ6RvLMEkWwReqPwnUTWaP2efp8GXY55uN-_nCVncTelqSPRTROP8YQm-HJ7crKf41D8Uudgg Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:37.921620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 1559984d24f4441d915b84c791ee7548 Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '4f72d6a3-f03c-45f4-910c-332049fb087e'} Sep 07 19:14:37.922714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. (HTTP 404) (Request-ID: req-88a05374-a2e4-4e73-9db9-df47962574a7) Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.923406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:37.924300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 19:14:37.925300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. Sep 07 19:14:37.926242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:37.928577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bd66775-e19b-4c37-9e79-7e2db6652e4f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Returning 404 to user: Snapshot 4f72d6a3-f03c-45f4-910c-332049fb087e could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:37.929624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7bd66775-e19b-4c37-9e79-7e2db6652e4f tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e" status: 404 len: 111 microversion: 2.1 time: 0.106302 Sep 07 19:14:37.930332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 17/26] 10.222.0.46 () {58 vars in 1251 bytes} [Wed Sep 7 19:14:37 2022] GET /compute/v2.1/os-snapshots/4f72d6a3-f03c-45f4-910c-332049fb087e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:14:37.942240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6288ae50-ead0-4ac5-bad2-8964fad5c1ab tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4db1a10d0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:38.132403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6288ae50-ead0-4ac5-bad2-8964fad5c1ab tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.197735 Sep 07 19:14:38.134578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 18/27] 10.222.0.46 () {58 vars in 1170 bytes} [Wed Sep 7 19:14:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:38.142425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c8ce6ff0-ffcc-4bdb-a618-2df430196125 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4db128d30>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:38.409586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c8ce6ff0-ffcc-4bdb-a618-2df430196125 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 202 len: 0 microversion: 2.1 time: 0.273063 Sep 07 19:14:38.410318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 19/28] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:14:38 2022] DELETE /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:14:38.730417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4f497ef8-7cd8-481a-beb6-ab1634b81914 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: .version_select at 0x7ff4db12ed30>, body: {"keypair": {"name": "tempest-keypair-225129247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMzgcS+eygjFWDyQMlIn3Kcjk44jphZwww9ff/HsCdYkc1ZfksCLTAOm6Q/ckHYC6O5lGugb/efxruFsZrUrCl0W9MqdO2JTEPjgQZNsFKHBK2RBEkCSjKPrI9+V93Amw=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:38.809055 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-4f497ef8-7cd8-481a-beb6-ab1634b81914 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:14:38.819234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-4f497ef8-7cd8-481a-beb6-ab1634b81914 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for user 920bdd998f0c4b62b108afc799a43964 and project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:14:38.939183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4f497ef8-7cd8-481a-beb6-ab1634b81914 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.527614 Sep 07 19:14:38.940712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 20/29] 10.222.0.46 () {62 vars in 1200 bytes} [Wed Sep 7 19:14:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 530 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 19:14:38.986351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:14:38.987045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:14:38.987792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:14:38.988370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:14:38.988978 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:14:39.035595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:39.035595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:39.035595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:39.035932 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:39.036406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:39.037034 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:39.069514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:14:39.092568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for user 847f6bef4e7b44f4b0adf1bda9dadb7e and project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:14:39.092568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:14:39.095209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:14:39.180090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-973457524", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "networks": [{"uuid": "7fb76d09-89b3-4f23-b65b-c52251de3111"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:39.306100 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] validate_networks() for [('7fb76d09-89b3-4f23-b65b-c52251de3111', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:14:39.354452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad0eca18-fb09-4a46-907f-19d1541b2306 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.799037 Sep 07 19:14:39.356165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 10/30] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:14:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:14:39.381802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b0e5b7a-bc30-46a8-9c13-d4004a715cbc tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4da8543a0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:39.640440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b0e5b7a-bc30-46a8-9c13-d4004a715cbc tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.282824 Sep 07 19:14:39.650273 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 11/31] 10.222.0.46 () {58 vars in 1155 bytes} [Wed Sep 7 19:14:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:39.655783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f2bb248-b0b1-4fbf-a41f-fb88c3d8b3a3 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4da854ee0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:39.817105 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f2bb248-b0b1-4fbf-a41f-fb88c3d8b3a3 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 200 len: 344 microversion: 2.1 time: 0.168551 Sep 07 19:14:39.817842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 12/32] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:39 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:40.334212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a59d556b-067e-49e8-9b72-c1f949052535 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Action: 'create', calling method: .version_select at 0x7ff4da854550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1892415926", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a59d556b-067e-49e8-9b72-c1f949052535 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 122 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:14:40.346470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1892415926", "metadata": {"Type": "work"}}} Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: Sep 07 19:14:40.347692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1892415926', 'metadata': {'Type': 'work'}}}} Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:40.348468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 19:14:40.349628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 19:14:40.350657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 19:14:40.350657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.353695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a59d556b-067e-49e8-9b72-c1f949052535 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:40.355782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a59d556b-067e-49e8-9b72-c1f949052535 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.537156 Sep 07 19:14:40.364129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 13/33] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Sep 7 19:14:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 546 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:14:40.386527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d0af9a38-7dc0-47cd-b51a-087535ac9392 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:40.388908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d0af9a38-7dc0-47cd-b51a-087535ac9392 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:40.514158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d0af9a38-7dc0-47cd-b51a-087535ac9392 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:40.544080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d0af9a38-7dc0-47cd-b51a-087535ac9392 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1221 microversion: 2.1 time: 0.177977 Sep 07 19:14:40.544772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 14/34] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:40 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1221 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:40.549800 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7f4d11b-daa1-40fc-8efd-f5f8f0de6a57 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4da854670>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:40.609394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:14:40.609394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:14:40.609394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:14:40.609394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:14:40.609394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:14:40.643769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:40.644280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:40.644733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:40.645483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:40.649985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:40.650469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:40.681046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7f4d11b-daa1-40fc-8efd-f5f8f0de6a57 tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133528 Sep 07 19:14:40.681889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 15/35] 10.222.0.46 () {58 vars in 1188 bytes} [Wed Sep 7 19:14:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:40.687485 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3dd06256-5808-4691-a610-b17af7e5a14e tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Action: 'create', calling method: .version_select at 0x7ff4da8338b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-379082419", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3dd06256-5808-4691-a610-b17af7e5a14e tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 119 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:14:40.698165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-379082419", "metadata": {"Type": "work"}}} Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: Sep 07 19:14:40.699844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-379082419', 'metadata': {'Type': 'work'}}}} Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '0' Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:40.700499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 19:14:40.702120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 19:14:40.703698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 19:14:40.703698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.711587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3dd06256-5808-4691-a610-b17af7e5a14e tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:40.712831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3dd06256-5808-4691-a610-b17af7e5a14e tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029762 Sep 07 19:14:40.721074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 16/36] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Sep 7 19:14:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:14:40.728852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2ac9b805-6481-48c8-8cc7-2bd5203609dc tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] Calling method '.version_select at 0x7ff4da833160>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:40.737599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Getting quotas for project d3e10ea750ae4455b7bc482b0db2ce6d. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:14:40.748267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Getting quotas for user ddf07a7d8aed4b3faf058c66347cf315 and project d3e10ea750ae4455b7bc482b0db2ce6d. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:14:40.793586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:14:40.810383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:14:40.852850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2ac9b805-6481-48c8-8cc7-2bd5203609dc tempest-VolumesTestJSON-486623993 tempest-VolumesTestJSON-486623993-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126156 Sep 07 19:14:40.853820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 17/37] 10.222.0.46 () {58 vars in 1155 bytes} [Wed Sep 7 19:14:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:40.859268 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1c9d21d-1d84-4612-b1a0-f52e1118f877 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Action: 'create', calling method: .version_select at 0x7ff4da7bd9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-867591398", "metadata": {"Type": "work"}}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1c9d21d-1d84-4612-b1a0-f52e1118f877 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 118 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:14:40.864204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-867591398", "metadata": {"Type": "work"}}} Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: Sep 07 19:14:40.876063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-867591398', 'metadata': {'Type': 'work'}}}} Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise error Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi '' Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:40.876801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 19:14:40.877854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 19:14:40.880316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 19:14:40.880316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:14:40.880316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1c9d21d-1d84-4612-b1a0-f52e1118f877 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:40.880316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1c9d21d-1d84-4612-b1a0-f52e1118f877 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010694 Sep 07 19:14:40.880316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 18/38] 10.222.0.46 () {60 vars in 1156 bytes} [Wed Sep 7 19:14:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:14:40.885637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fdee1c74-346b-475f-8df2-88cebec97cee tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4da7bd8b0>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:40.966211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fdee1c74-346b-475f-8df2-88cebec97cee tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 200 len: 344 microversion: 2.1 time: 0.096612 Sep 07 19:14:40.968748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 19/39] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:40 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:40.986229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-901594259", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:41.093540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] validate_networks() for [('130327f0-428b-45b4-96e8-f00208541c08', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:14:41.120104 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-54015cdc-9ae0-41bd-a61c-e8af700bac9f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.178114 Sep 07 19:14:41.130955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:14:41.136796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-919c05a6-fd97-456d-a800-abc22da04407 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Calling method '.version_select at 0x7ff4db03d4c0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:41.214313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-919c05a6-fd97-456d-a800-abc22da04407 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] HTTP exception thrown: Volume tempest-invalid-1978572647 could not be found. Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-919c05a6-fd97-456d-a800-abc22da04407 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1978572647 HTTP/1.1 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:41.216518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume tempest-invalid-1978572647 could not be found. Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'tempest-invalid-1978572647'} Sep 07 19:14:41.218473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1978572647 could not be found. (HTTP 404) (Request-ID: req-48b25e9e-eba9-478a-a871-cf3833344aff) Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:41.220546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1978572647 could not be found. Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:41.221820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1978572647 could not be found. Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1978572647 could not be found. Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-919c05a6-fd97-456d-a800-abc22da04407 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 404 to user: Volume tempest-invalid-1978572647 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:41.223164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-919c05a6-fd97-456d-a800-abc22da04407 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1978572647" status: 404 len: 99 microversion: 2.1 time: 0.088757 Sep 07 19:14:41.224992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 22/41] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Sep 7 19:14:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1978572647 => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 19:14:41.246232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fd2039d6-a2a9-467e-956b-91f11924a165 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:41.247141 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fd2039d6-a2a9-467e-956b-91f11924a165 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:41.488235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fd2039d6-a2a9-467e-956b-91f11924a165 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:41.513734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fd2039d6-a2a9-467e-956b-91f11924a165 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1214 microversion: 2.1 time: 0.288362 Sep 07 19:14:41.515747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:41 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:41.522861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e16ca836-f74d-4bac-bcb0-c07520df07f9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005557 Sep 07 19:14:41.528217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 24/43] 10.222.0.46 () {58 vars in 1140 bytes} [Wed Sep 7 19:14:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 19:14:41.541519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78bdc0f4-c7f9-497f-91bf-31e71359a786 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007725 Sep 07 19:14:41.541519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 25/44] 10.222.0.46 () {58 vars in 1137 bytes} [Wed Sep 7 19:14:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 19:14:41.559974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7bd17ec-f3b6-459c-94a5-03a7022a8113 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Calling method '.version_select at 0x7ff4dafe9670>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:41.618657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-e7bd17ec-f3b6-459c-94a5-03a7022a8113 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] HTTP exception thrown: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7bd17ec-f3b6-459c-94a5-03a7022a8113 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/os-volumes/0c17f7bd-459d-4c20-b1f9-824df8cae2c2 HTTP/1.1 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:41.633397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '0c17f7bd-459d-4c20-b1f9-824df8cae2c2'} Sep 07 19:14:41.634798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. (HTTP 404) (Request-ID: req-538447b9-cfb6-45b9-be9d-0100da1880c6) Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.635563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:41.636750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 19:14:41.637897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. Sep 07 19:14:41.639217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.640708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7bd17ec-f3b6-459c-94a5-03a7022a8113 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 404 to user: Volume 0c17f7bd-459d-4c20-b1f9-824df8cae2c2 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:41.642133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7bd17ec-f3b6-459c-94a5-03a7022a8113 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/0c17f7bd-459d-4c20-b1f9-824df8cae2c2" status: 404 len: 109 microversion: 2.1 time: 0.096445 Sep 07 19:14:41.650946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 26/45] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:14:41 2022] DELETE /compute/v2.1/os-volumes/0c17f7bd-459d-4c20-b1f9-824df8cae2c2 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:14:41.678537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eed724a2-3458-47a2-b471-adb8fb7e10e9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Calling method '.version_select at 0x7ff4da78eaf0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:41.775126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-eed724a2-3458-47a2-b471-adb8fb7e10e9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] HTTP exception thrown: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eed724a2-3458-47a2-b471-adb8fb7e10e9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Request method failure captured: Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/c76c1ab5-7383-4e52-9155-957e71c79155 HTTP/1.1 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2e2Vr6g5L8PK8nplnEcY6QKtvnwrMo6KaeVlYH9zBnbpz1ScG7nHnQarMkTBmKfJbuOR7h_9YXzF7F3QW8ARQs1C7F7RRqLCMHX1pvWQ8zntHBDRkymNwRjbZ__AuG2xAjGPeDRi-XioEhkFpU2sil0ueJYHXG-jgCKaUdcpOA0sc Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:41.777094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/332a6aeb4ada4c7985045bcf95f38ed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 332a6aeb4ada4c7985045bcf95f38ed5 Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesNegativeTest-949031829 Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f031c535798743a6ad2114d8c0e05d76 Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesNegativeTest-949031829-project Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'c76c1ab5-7383-4e52-9155-957e71c79155'} Sep 07 19:14:41.778163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. (HTTP 404) (Request-ID: req-92eb1d4e-e1b4-4f48-9476-1890918e17f3) Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.779263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:41.780182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 19:14:41.787398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eed724a2-3458-47a2-b471-adb8fb7e10e9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] Returning 404 to user: Volume c76c1ab5-7383-4e52-9155-957e71c79155 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eed724a2-3458-47a2-b471-adb8fb7e10e9 tempest-VolumesNegativeTest-949031829 tempest-VolumesNegativeTest-949031829-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/c76c1ab5-7383-4e52-9155-957e71c79155" status: 404 len: 109 microversion: 2.1 time: 0.125218 Sep 07 19:14:41.788484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 27/46] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:41 2022] GET /compute/v2.1/os-volumes/c76c1ab5-7383-4e52-9155-957e71c79155 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:14:41.980961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-657dc683-63ae-4d86-97d3-0d7186592202 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4dafe9430>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:42.026342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:14:42.027592 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:14:42.028548 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:14:42.029182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:14:42.029811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:14:42.071849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:42.071849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:42.071849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:42.071849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:42.072454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:42.072454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:42.085567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-657dc683-63ae-4d86-97d3-0d7186592202 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] HTTP exception thrown: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-657dc683-63ae-4d86-97d3-0d7186592202 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Request method failure captured: Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 HTTP/1.1 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2Qt4tJJT5Lt9NLF6W9SDk1GjRdY5guZdVncOOMj3KB_rWUabVlaB9N7u4weJeyIWyFtOmxwLtjKKeNlwwQ9gVkAxbc1d46TQ-6IgCJ6RvLMEkWwReqPwnUTWaP2efp8GXY55uN-_nCVncTelqSPRTROP8YQm-HJ7crKf41D8Uudgg Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:42.087545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 1559984d24f4441d915b84c791ee7548 Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '32e09e6d-6178-4efc-a836-095633638870'} Sep 07 19:14:42.088898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. (HTTP 404) (Request-ID: req-80b8ef86-566a-4136-907d-46d5f0b94528) Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.089686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:42.090650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 19:14:42.091692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-657dc683-63ae-4d86-97d3-0d7186592202 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Returning 404 to user: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-657dc683-63ae-4d86-97d3-0d7186592202 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 404 len: 109 microversion: 2.1 time: 0.112360 Sep 07 19:14:42.101105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 28/47] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:41 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:14:42.116034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48fde622-51df-40ae-81be-0b72db085377 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4dafe9160>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:42.134145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:14:42.190997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for user 847f6bef4e7b44f4b0adf1bda9dadb7e and project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:14:42.215949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-48fde622-51df-40ae-81be-0b72db085377 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] HTTP exception thrown: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48fde622-51df-40ae-81be-0b72db085377 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Request method failure captured: Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 HTTP/1.1 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2Qt4tJJT5Lt9NLF6W9SDk1GjRdY5guZdVncOOMj3KB_rWUabVlaB9N7u4weJeyIWyFtOmxwLtjKKeNlwwQ9gVkAxbc1d46TQ-6IgCJ6RvLMEkWwReqPwnUTWaP2efp8GXY55uN-_nCVncTelqSPRTROP8YQm-HJ7crKf41D8Uudgg Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:42.220866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 1559984d24f4441d915b84c791ee7548 Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '32e09e6d-6178-4efc-a836-095633638870'} Sep 07 19:14:42.222028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. (HTTP 404) (Request-ID: req-be506f10-f0d1-4ae0-8d65-48bc1a2e45e7) Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.222742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 19:14:42.225730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 19:14:42.232522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48fde622-51df-40ae-81be-0b72db085377 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Returning 404 to user: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48fde622-51df-40ae-81be-0b72db085377 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 404 len: 109 microversion: 2.1 time: 0.118796 Sep 07 19:14:42.233745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 29/48] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:14:42 2022] DELETE /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:14:42.234639 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:14:42.236887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:14:42.238475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fa904c90-3de7-457e-9781-2a840bcfedc2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Calling method '.version_select at 0x7ff4da78e430>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:42.303740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-fa904c90-3de7-457e-9781-2a840bcfedc2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] HTTP exception thrown: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fa904c90-3de7-457e-9781-2a840bcfedc2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Request method failure captured: Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 HTTP/1.1 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2Qt4tJJT5Lt9NLF6W9SDk1GjRdY5guZdVncOOMj3KB_rWUabVlaB9N7u4weJeyIWyFtOmxwLtjKKeNlwwQ9gVkAxbc1d46TQ-6IgCJ6RvLMEkWwReqPwnUTWaP2efp8GXY55uN-_nCVncTelqSPRTROP8YQm-HJ7crKf41D8Uudgg Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:14:42.306371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b2eaefbf6c1842e590d71e1d94e32903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: b2eaefbf6c1842e590d71e1d94e32903 Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1625167418 Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 1559984d24f4441d915b84c791ee7548 Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1625167418-project Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '32e09e6d-6178-4efc-a836-095633638870'} Sep 07 19:14:42.307819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. (HTTP 404) (Request-ID: req-8fb77f8a-939d-4e14-b57b-94b35fe9a171) Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.308593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 19:14:42.309715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 19:14:42.311959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. Sep 07 19:14:42.312939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:14:42.314461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fa904c90-3de7-457e-9781-2a840bcfedc2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] Returning 404 to user: Volume 32e09e6d-6178-4efc-a836-095633638870 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:14:42.323298 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fa904c90-3de7-457e-9781-2a840bcfedc2 tempest-VolumesSnapshotsTestJSON-1625167418 tempest-VolumesSnapshotsTestJSON-1625167418-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870" status: 404 len: 109 microversion: 2.1 time: 0.087739 Sep 07 19:14:42.323298 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 30/49] 10.222.0.46 () {58 vars in 1245 bytes} [Wed Sep 7 19:14:42 2022] GET /compute/v2.1/os-volumes/32e09e6d-6178-4efc-a836-095633638870 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:14:42.497389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fabb4e90-6897-42a6-8464-484fe9111cf5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.525161 Sep 07 19:14:42.501362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 20/50] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:14:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:14:42.512036 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4c21517f-e37d-411f-ba65-67093e93d749 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:42.512715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4c21517f-e37d-411f-ba65-67093e93d749 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:42.545737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b42c8774-d7d5-450e-abe8-b438c41259b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:42.552191 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b42c8774-d7d5-450e-abe8-b438c41259b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:42.726194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4c21517f-e37d-411f-ba65-67093e93d749 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:42.740263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4c21517f-e37d-411f-ba65-67093e93d749 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1221 microversion: 2.1 time: 0.229727 Sep 07 19:14:42.745386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 31/51] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:42 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:42.835106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b42c8774-d7d5-450e-abe8-b438c41259b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:42.846417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b42c8774-d7d5-450e-abe8-b438c41259b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1214 microversion: 2.1 time: 0.309810 Sep 07 19:14:42.849359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 21/52] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:42 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:14:43.781733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-23200653-04f9-4a04-aa15-d7cd9d43bdb5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:43.781733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-23200653-04f9-4a04-aa15-d7cd9d43bdb5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:43.876738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c002000-2fe7-4b3f-870e-d096dde2801a tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:43.877973 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c002000-2fe7-4b3f-870e-d096dde2801a tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:44.280836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-23200653-04f9-4a04-aa15-d7cd9d43bdb5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:44.303236 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-23200653-04f9-4a04-aa15-d7cd9d43bdb5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1221 microversion: 2.1 time: 0.534206 Sep 07 19:14:44.306514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 32/53] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:43 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1221 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:44.323918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1325892683", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b43c0fa0-38b1-4590-b1ab-4ffbd8daf6a9"}], "security_groups": [{"name": "tempest-securitygroup--66783111"}], "key_name": "tempest-keypair-225129247", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:44.407994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c002000-2fe7-4b3f-870e-d096dde2801a tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:44.420010 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c002000-2fe7-4b3f-870e-d096dde2801a tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1214 microversion: 2.1 time: 0.548582 Sep 07 19:14:44.425403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 22/54] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:43 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1214 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:14:44.651880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] validate_networks() for [('b43c0fa0-38b1-4590-b1ab-4ffbd8daf6a9', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:14:45.330536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:45.331737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:45.345556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.346104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.346432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.347594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.348096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.348536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.477459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:14:45.482171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:14:45.482171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:14:45.482171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:14:45.482171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:14:45.511244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.516708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.517479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.519302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.520889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.521780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.563850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:14:45.572058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for user 920bdd998f0c4b62b108afc799a43964 and project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:14:45.598146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:14:45.599549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:14:45.640499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:45.663745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8f09c0fb-1815-4c96-b082-50210468d382 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1217 microversion: 2.1 time: 0.336971 Sep 07 19:14:45.672362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 23/55] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:45 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1217 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:14:45.680173 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:45.682293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:45.694480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.695042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.695580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.696395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:45.698087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:45.699039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:45.757042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9a94c5eb-325a-4720-9857-86839cc9470e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.445167 Sep 07 19:14:45.759299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 33/56] 10.222.0.46 () {62 vars in 1188 bytes} [Wed Sep 7 19:14:44 2022] POST /compute/v2.1/servers => generated 400 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 19:14:45.776126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:45.782184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:45.994213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:46.001860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:46.013810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:46.018859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3821c4cc-7ce6-4c0b-a346-57d223127fb5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1266 microversion: 2.1 time: 0.344621 Sep 07 19:14:46.023723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:46.029790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7bf7ea1b-7bd4-4bd9-8cc3-298e74358d9d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1281 microversion: 2.20 time: 0.262055 Sep 07 19:14:46.032070 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 24/57] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:45 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:46.034886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 34/58] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:45 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1281 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:46.691204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:46.692875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:46.698167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:46.698708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:46.699142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:46.699835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:46.700317 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:46.700905 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:46.844218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:46.855427 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b16f863-f881-486f-ae52-baaf73fc9c01 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1273 microversion: 2.1 time: 0.168405 Sep 07 19:14:46.858911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 25/59] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:46 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:47.059879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:47.060703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:47.080281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:47.082864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:47.105311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:47.108339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:47.114775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:47.116453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:47.121859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:47.121859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:47.221269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:47.239936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:47.242620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:47.260603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea1a5fc8-58f4-4064-a933-15c1dd55b2a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1281 microversion: 2.20 time: 0.179758 Sep 07 19:14:47.274910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 26/60] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:47 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:47.493868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:47.522712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-852159f8-a1b5-419a-9c94-6c35d944b7d4 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1272 microversion: 2.1 time: 0.467211 Sep 07 19:14:47.524120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 35/61] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:47 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1272 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:47.882227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:47.883718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:47.898710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:47.900252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:47.904186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:47.908591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:47.909780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:47.911595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:48.210837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:48.226078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1451bad8-63ae-4c14-a45b-450d4d1e6991 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1279 microversion: 2.1 time: 0.348608 Sep 07 19:14:48.231607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 27/62] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:47 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:48.277886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:48.279873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:48.310350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:48.313703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:48.315078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:48.317123 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:48.324762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:48.326002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:48.571964 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:48.575443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:48.643036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:48.643036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:48.671709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:48.673237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:48.674141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:48.692302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:49.387833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:49.396289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:49.397851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:49.398926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f66eb89b-e46f-43c7-879a-0c457a5728fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1277 microversion: 2.20 time: 1.125940 Sep 07 19:14:49.413084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 36/63] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:48 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1277 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:49.418934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:49.429840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:49.436736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:49.438696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:49.438696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:49.438696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:49.441490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:49.442092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:49.975356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:49.994694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cf43779b-28b4-4a54-840c-e879fac83e73 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 1.450292 Sep 07 19:14:49.996136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 28/64] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:48 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:50.444003 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:50.446713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:50.463283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:50.479165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:50.480932 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:50.481825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:50.482336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:50.488735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:50.665336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:50.669267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c7f9e0f1-cab3-4b90-9cbb-b8474990dd7c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 1.254842 Sep 07 19:14:50.685816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 37/65] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:49 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:50.784556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:50.817273 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:50.839637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:50.848756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-be04b522-03ee-452f-b635-2ca606e17228 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1351 microversion: 2.20 time: 0.412503 Sep 07 19:14:50.848756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 29/66] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:50 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1351 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:51.029717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:51.030497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:51.044062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.046334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.049533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:51.053116 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.055085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.057458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:51.445121 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:51.454073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1cb2992f-b43b-4307-9e3e-4884b3eb5406 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.436454 Sep 07 19:14:51.462242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 38/67] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:51 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:51.701241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:51.703106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:51.736517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.743399 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.744568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:51.745515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.746291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.747014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:51.890279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:51.890279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:51.903538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.904028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.904696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:51.905566 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:51.906169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:51.906776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:52.116366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:52.117669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:52.128458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:52.140019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:52.141493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-170f4468-a29d-4138-ba7f-fe6f94146fe1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1339 microversion: 2.20 time: 0.270735 Sep 07 19:14:52.142659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 39/68] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:51 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1339 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:52.463144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:52.473701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6a7ab4c4-0529-441b-892d-9d656bbdf9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.779509 Sep 07 19:14:52.479093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 30/69] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:51 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:52.489969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:52.493592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:52.504872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:52.508361 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:52.508824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:52.509592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:52.510039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:52.510458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:53.173763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:53.174453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:53.187480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:53.188225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:53.191571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:53.192681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:53.193497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:53.195226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:53.736821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:53.747264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2b792c86-13ec-47c9-9e4a-23fe5720983e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 1.264770 Sep 07 19:14:53.750158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 40/70] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:52 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:53.763002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:53.764547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:53.777243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:53.779201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:53.781388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:53.783209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:53.787147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:53.787815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:54.138956 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:54.152305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:54.162989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:54.174799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:54.174799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b4e7b19-e747-453c-bd37-0ecd15777ec0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.995365 Sep 07 19:14:54.174799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 31/71] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:53 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:14:54.175586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d3c43c95-8de1-47da-ae21-c5c0639d8ac5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.420257 Sep 07 19:14:54.175586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 41/72] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:53 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:55.140345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca91c2bd-b822-4ce2-82fa-605aea3fb036", "tag": "68a7b1dc-fa71-4330-94bf-fdf595322923"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:55.164957 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.165919 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.166806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.173858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f3725f-cd16-4277-be1b-ef47b8c92ca0", "tag": "13fb3160-88c3-471a-834d-9476f251fa88"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:55.189451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.190700 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.191973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.201070 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Creating event network-changed:68a7b1dc-fa71-4330-94bf-fdf595322923 for instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 on hv-cinder-84773 Sep 07 19:14:55.202969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 19:14:55.203562 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad6171be-978b-4d47-8b8c-db74f15503e6 req-3b94c6aa-30b0-4c4a-91b1-4c7d75a82079 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 19:14:55.204805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.205801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.206467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.207853 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.208507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.224459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.243208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.compute.rpcapi [None req-82a46982-2698-422d-945a-e67485d92861 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 19:14:55.244771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-82a46982-2698-422d-945a-e67485d92861 None None] Releasing lock "compute-rpcapi-router" {{(pid=121079) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 19:14:55.260948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Creating event network-changed:13fb3160-88c3-471a-834d-9476f251fa88 for instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 on hv-cinder-84773 Sep 07 19:14:55.261782 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 19:14:55.262388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-19b03798-0fcc-47a2-92fa-35db92cb4af2 req-fcc11336-5e79-4239-bbb6-ced1cd26d458 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 19:14:55.264217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.265015 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.265653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.266797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.267810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.268472 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.280484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.compute.rpcapi [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 19:14:55.281698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] Releasing lock "compute-rpcapi-router" {{(pid=121080) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 19:14:55.282750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-82a46982-2698-422d-945a-e67485d92861 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.095324 Sep 07 19:14:55.285050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 32/73] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:55.298711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:55.299435 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:55.307579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.308656 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.309682 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.311484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.313367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.313994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.314414 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34047c47-9008-4f83-bed3-7d35480ffa50 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.076889 Sep 07 19:14:55.316169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 42/74] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:14:55.328268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:55.329670 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:55.336927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.339622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.339622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.339622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.340137 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.340785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.577896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:55.586379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-93bd10f4-6a48-4e5d-9440-74d553f5f09b tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.299656 Sep 07 19:14:55.586995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 33/75] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:55 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:55.602608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:55.603588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:55.625161 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.630797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.631514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.632441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:55.635188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:55.636440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:55.745598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:55.761748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:55.771669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:55.774485 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-937257bc-2951-4b0d-93bc-faebf4c33c5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.456043 Sep 07 19:14:55.800768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 43/76] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:55 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:55.975058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:55.986564 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-90826e57-0ce6-4384-af7a-efc1b8a77f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.394003 Sep 07 19:14:55.989486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 34/77] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:55 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:56.616434 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:56.620980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:56.647953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=24 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:56.653561 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:56.654091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:56.662097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:56.669742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:56.669742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:56.669742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:56.807799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:56.809024 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:56.829325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:56.832110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:56.834650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:56.835646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:56.837622 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:56.838286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:57.238688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=20 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:14:57.518538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:57.551056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3095470b-b6a1-4fef-860f-f01b04d3efbc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.932540 Sep 07 19:14:57.551056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 44/78] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:56 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:57.556143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:57.558426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:57.566189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:57.572437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:57.578257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:57.579891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:57.580593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:57.581278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:57.801242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:57.813403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:57.815009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:57.821187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e48bec0-8e9d-40ec-9eb2-f0c898f22c2a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 1.016339 Sep 07 19:14:57.831045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 35/79] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:56 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:14:57.845580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9", "tag": "c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:57.856421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:57.856908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:57.857702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:57.875275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] Creating event network-changed:c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0 for instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 on hv-cinder-84773 Sep 07 19:14:57.880597 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b1cecafa-852c-44cf-82b6-445eb197eca9 req-c84cf662-8425-4aec-80db-98fe06f0b4a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047445 Sep 07 19:14:57.881853 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 36/80] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:57.888139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:14:57.905561 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:57.906687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:57.907411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:57.927278 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] Creating event network-changed:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:14:57.934226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e7a8e2e7-934c-4f6d-bb47-244a1f882a63 req-c41c6292-97ac-46e1-adf6-de2c2cce92ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050471 Sep 07 19:14:57.935738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 37/81] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:14:58.001248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:58.020455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf3a7377-174e-4911-9741-a981d6c802ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.468857 Sep 07 19:14:58.021244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 45/82] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:57 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:58.576107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:58.580358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:58.583246 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:58.583810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:58.584347 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:58.585142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:58.585658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:58.586306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:58.836996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:58.849334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:58.850282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:58.852299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-397687db-add7-4db7-8b8a-725e6309975f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.279988 Sep 07 19:14:58.862280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:58.862799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:58.863231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:58.863962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:58.864416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:58.864837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:58.867203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 38/83] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:58 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:59.045594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:59.046219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:59.056645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:59.057144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:59.057588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:59.058301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:59.058787 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:59.059216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:59.266240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:59.275649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:59.279750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:59.284066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0e5599fb-32e5-492b-aa93-045641c592f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.434202 Sep 07 19:14:59.297532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 46/84] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:14:58 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:14:59.405148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:14:59.425774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7c92e80-0b6a-4c34-bdc8-22cd0c53dfdd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.383776 Sep 07 19:14:59.437990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 39/85] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:59 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:14:59.880075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:14:59.880075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:14:59.886903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:59.887564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:59.889601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:14:59.890528 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:14:59.891043 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:14:59.891536 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:00.070202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:00.078805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b03a91b7-f200-4ffb-b9d9-158f1098241d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.205349 Sep 07 19:15:00.081716 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 47/86] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:14:59 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:00.316801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:00.318294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:00.328484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:00.329210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:00.329676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:00.330352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:00.330862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:00.331280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:00.462773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:00.467527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:00.472947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:00.473798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:00.474460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:00.475457 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:00.476151 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:00.476799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:00.526357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:00.538583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:00.540261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:00.542836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb82259d-77ab-48ba-87b9-b95349b99d7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.228965 Sep 07 19:15:00.543776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 40/87] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:00 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:00.630099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:00.639090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-65e66e11-4c8a-43bc-bc20-4621356bd2dd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.185011 Sep 07 19:15:00.647277 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 48/88] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:00 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:01.105238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:01.105855 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:01.112336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.112815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.113299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.114027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.114480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.114951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.133191 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:01.248127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:01.253015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b3c5fe4-96b7-4e32-99fc-7e260388f5e1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.151664 Sep 07 19:15:01.253755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 41/89] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:01 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:01.567959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:01.568480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:01.574505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.575032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.575468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.576767 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.577223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.577737 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.661981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:01.662800 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:01.670416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.671367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.671491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.672109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:01.672559 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:01.672984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:01.762657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:01.772348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:01.773864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:01.775162 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-648ac4be-edf3-46a8-8b7b-1e7d62010065 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.211266 Sep 07 19:15:01.780211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 49/90] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:01 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:01.889899 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:01.911726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3484ca3d-c388-4d49-9e42-167d138f9c1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.254164 Sep 07 19:15:01.912322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 42/91] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:01 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:02.276398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:02.277112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:02.284004 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.284553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.284985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.285671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.286120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.286542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.444146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:02.452090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb85f819-2c52-46b2-97bc-edbde302a029 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.179628 Sep 07 19:15:02.452827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 50/92] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:02 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:02.800204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:02.800962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:02.807449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.807997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.808605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.809521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.810059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.810542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.935435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:02.936144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:02.942148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.942667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.943103 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.943955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:02.944512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:02.944940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:02.949024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:02.951565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:02.959645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:02.961107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:02.962198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a58c1deb-198f-4cd2-8601-aadde564eba0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.166240 Sep 07 19:15:02.962780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 43/93] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:02 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:03.077951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:03.085803 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e468d789-d7d8-4a53-b961-d9d8e77a62cd tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.154508 Sep 07 19:15:03.092784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 51/94] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:02 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:03.475783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:03.476391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:03.482996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:03.483477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:03.489797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:03.489797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:03.489797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:03.489797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:03.678150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:03.686824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-01d04142-e429-4bf4-83a6-54eac7e44408 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.214960 Sep 07 19:15:03.687400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 44/95] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:03 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:03.988478 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:03.989078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:03.995262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:03.995906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:03.996336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:03.997072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:03.998010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:03.998432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:04.109788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:04.110409 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:04.116377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:04.116867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:04.117308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:04.118002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:04.118458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:04.118918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:04.228752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:04.238197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:04.239777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:04.241052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9499f0d3-a1ed-4bc8-b902-6ce9b1512296 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.256904 Sep 07 19:15:04.253836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 52/96] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:03 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:04.296137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:04.303995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cc07e314-d794-444a-b219-3791d06c724a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.198611 Sep 07 19:15:04.304611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 45/97] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:04 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:04.709312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:04.709916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:04.712852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:04.716994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:04.717487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:04.717909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:04.718671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:04.719122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:04.719543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:04.849489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:04.862585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f0e451e5-d69d-4c19-8fab-0b3535dfc23d tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.157033 Sep 07 19:15:04.863388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 53/98] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:04 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:05.267362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:05.267974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:05.269801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:05.274783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.275265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.275699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:05.276395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.276847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.277270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:05.328224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:05.328921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:05.331212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:05.336508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.337251 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.337853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:05.338582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.339030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.339450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:05.465112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:05.475621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:05.477541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:05.478862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fc499ee2-36bd-42eb-8b6c-aee1be0e2353 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.215990 Sep 07 19:15:05.491568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 46/99] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:05 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:05.529066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:05.537229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-410a0575-6ecc-4d48-b5ce-3d90ad52432d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.213539 Sep 07 19:15:05.537810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 54/100] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:05 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:05.885245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:05.885883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:05.892302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.892782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.893211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:05.893889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:05.894335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:05.894781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:06.033358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:06.040991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9487d303-5878-4149-8ef8-e0db93e3ccf1 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.159613 Sep 07 19:15:06.041563 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 47/101] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:05 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:06.515529 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:06.516061 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:06.522215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:06.522735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:06.523170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:06.523858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:06.524307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:06.525052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:06.564640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:06.565384 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:06.567259 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:06.572150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:06.572643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:06.573081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:06.573784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:06.574241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:06.574697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:06.720910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:06.734363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:06.739759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:06.741489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fdd85f91-eabb-4b24-982a-0af285972bd9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.230791 Sep 07 19:15:06.742313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 55/102] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:06 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:06.771391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:06.781046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-48a74223-6a77-400f-af0e-e0a6e1ad538d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.220278 Sep 07 19:15:06.782128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 48/103] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:06 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:07.064285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:07.064818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:07.071881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.072378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.072820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.073524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.073984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.074411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.271479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:07.279509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a465655d-3463-4813-a016-4d315467701f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.219584 Sep 07 19:15:07.280623 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 56/104] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:07 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:07.768481 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:07.778043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:07.778043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.778043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.778043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.778509 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.778989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.779464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.804560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:07.805174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:07.812323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.813095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.813549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.814241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:07.814748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:07.815179 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:07.984358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:07.996963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:07.998752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:08.000050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-09efac29-30f8-48a8-9ffd-15a9645ed633 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.237132 Sep 07 19:15:08.001929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 49/105] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:07 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:08.068511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:08.080952 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e533a174-bc6a-419c-af3a-f2f799c35c41 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.280266 Sep 07 19:15:08.084831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 57/106] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:07 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:08.302726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:08.303317 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:08.309972 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:08.310461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:08.320729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:08.320729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:08.320729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:08.320729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:08.444456 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:08.452588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6ac3fe72-b487-473e-8f41-3d247b9a567c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.153395 Sep 07 19:15:08.453181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 50/107] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:08 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:09.025985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:09.026695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:09.033865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.034882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.035264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.035966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.036429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.036858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.105364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:09.105976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:09.112521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.112997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.113424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.114107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.115230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.119097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.227892 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:09.242881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:09.244349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:09.245525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79749366-df51-4891-8595-0034fbfef8e9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.223646 Sep 07 19:15:09.246262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 58/108] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:09 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:09.280397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:09.288195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0bd6087b-ac1a-44db-910d-a4730eeac54d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.186712 Sep 07 19:15:09.288761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 51/109] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:09 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:09.475231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:09.475941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:09.482537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.482537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.483154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.484592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:09.485142 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:09.485595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:09.613900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:09.621584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff980ba2-b867-47e8-a857-724eec1c2d34 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.150244 Sep 07 19:15:09.622157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 59/110] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:09 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:10.272538 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:10.273178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:10.279426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.279904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.280331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.281015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.281492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.281907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.312415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:10.313636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:10.320744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.322262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.326719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.326719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.326719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.326719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.478002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:10.488941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:10.490399 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:10.491635 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f42cd91f-cec9-461d-870e-6d53b38efcdd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.223086 Sep 07 19:15:10.503199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 52/111] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:10 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:10.512203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:10.521273 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4d194104-514e-4986-a6d0-dbdb7fb7fe44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.213006 Sep 07 19:15:10.521911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 60/112] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:10 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:10.644090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:10.645229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:10.650620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.651095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.651524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.652198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:10.652893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:10.653304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:10.790795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:10.793394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db7bedd2-41f5-4220-835d-14982ba42918 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.153030 Sep 07 19:15:10.793933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 53/113] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:10 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:11.519160 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:11.520053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:11.526511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.534742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.534742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.534742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.534742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.535155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.553391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:11.554149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:11.565013 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.569639 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.570282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.571437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.571893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.572316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.775525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:11.784695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:11.784937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:11.786149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:11.787320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e97cb78f-3f7e-445e-8155-b3e271f6cc99 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.273572 Sep 07 19:15:11.787885 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 61/114] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:11 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:11.797051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b07357cb-7260-4092-85d1-3c004d1ff29d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.254943 Sep 07 19:15:11.797931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 54/115] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:11 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:11.820207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:11.820887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:11.827857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.829461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.829461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.829722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:11.830353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:11.830971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:11.983025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:11.990812 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5f3dd2a8-6fd8-420d-8272-da90660936e6 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.174861 Sep 07 19:15:11.991472 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 62/116] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:11 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:12.813967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:12.814607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:12.820020 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:12.820637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:12.826838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:12.827436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:12.827876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:12.836056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:12.836056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:12.836271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:12.836366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:12.836454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:12.836454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:12.836454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:12.836454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:12.836759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:13.063994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:13.070082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:13.072851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:13.074306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:13.075474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a8d12e5d-3dce-4b3b-a81c-abc354e42b5e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.266090 Sep 07 19:15:13.076206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 55/117] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:12 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:13.078210 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f9f8710c-4f35-4e49-9822-9ee269178b07 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.261976 Sep 07 19:15:13.081190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:13.081796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:13.087720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:13.088217 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:13.088976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:13.089679 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:13.090153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:13.090578 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:13.091576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 63/118] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:12 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:13.260769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:13.270924 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7cff424d-c043-4ca4-bf4b-0c5ebf4f0c5c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.193292 Sep 07 19:15:13.271512 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 56/119] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:13 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:14.102032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:14.102780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:14.103984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:14.105181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:14.109405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.109887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.110316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.111035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.111483 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.111895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.112717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.113484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.113994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.114807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.115366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.115873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.320756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:14.329569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7ece7fed-cbe5-4e6f-b945-cb31ebbc7ab2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.231516 Sep 07 19:15:14.330156 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 57/120] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:14 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:14.334799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:14.335234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:14.335780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:14.341799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.343085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.343689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.346829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.346829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.347037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:14.347139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.347222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:14.348095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6db928f0-ba53-4bab-86ba-a815906ddb21 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.250349 Sep 07 19:15:14.348654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 64/121] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:14 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:14.349610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:14.487833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:14.495453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-61bcea13-7b16-4553-bea1-a32bae7ebbfc tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.164188 Sep 07 19:15:14.499196 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 58/122] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:14 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:14.825509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9", "name": "network-vif-plugged", "status": "completed", "tag": "c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:14.846223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:14.846810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:14.847382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:14.862177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] Creating event network-vif-plugged:c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0 for instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 on hv-cinder-84773 Sep 07 19:15:14.867723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-c067f13e-bfe7-4bfd-ad83-4f7ec5c4733f req-d3cb3169-5102-4aaf-81f5-1473057f2496 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119021 Sep 07 19:15:14.868321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 65/123] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:15:15.354480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:15.367660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:15.367660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.367660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.367660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.368015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.368015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.368015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.373447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:15.374756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:15.402415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.402415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.402415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.402415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.402778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.402778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.692930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:15.719166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c6a3c432-57af-4d11-8cf4-daffff756cb4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.352112 Sep 07 19:15:15.719166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 59/124] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:15 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:15.719379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:15.719469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:15.719469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:15.719594 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:15.719752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.719752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.719752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.719954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:15.720396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:15.720396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:15.720396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:15.720657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c3d564c8-c1d5-4203-a377-d5cd391a4748 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.349576 Sep 07 19:15:15.720657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 66/125] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:15 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:15.889790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:15.897462 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e3700241-d1b1-4264-9436-5899fb20cd1e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.193549 Sep 07 19:15:15.898005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 60/126] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:15 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:16.732194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:16.733855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:16.748880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:16.751967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:16.764690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:16.764793 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:16.765205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:16.765911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:16.767745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:16.768229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:16.768654 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:16.769354 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:16.770590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:16.770590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:16.774125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:16.779284 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:17.017744 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:17.027564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:17.032368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:17.035338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:17.037592 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4bdeacb-fe42-4d95-8a08-6ee4295d3543 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.293723 Sep 07 19:15:17.038657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 61/127] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:16 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:17.051253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c8aaf197-4db7-4a8c-af29-3e8df6f7dd89 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.313010 Sep 07 19:15:17.051253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 67/128] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:16 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:17.066862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:17.067734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:17.071364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca91c2bd-b822-4ce2-82fa-605aea3fb036", "name": "network-vif-plugged", "status": "completed", "tag": "68a7b1dc-fa71-4330-94bf-fdf595322923"}, {"server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "name": "network-vif-plugged", "status": "completed", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:17.075321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:17.076031 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:17.076650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:17.077406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:17.078063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:17.078689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:17.105387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:17.105915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:17.106495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:17.124897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Creating event network-vif-plugged:68a7b1dc-fa71-4330-94bf-fdf595322923 for instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 on hv-cinder-84773 Sep 07 19:15:17.125507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] Creating event network-vif-plugged:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:15:17.133081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-116bf0dc-b2e5-48f6-8374-498d78dce442 req-0d58bf37-be00-4951-beb9-91ce400a88c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090879 Sep 07 19:15:17.133754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 68/129] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:15:17.235525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:17.244729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-537d1089-da80-4399-9495-d0a148ecc92e tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1314 microversion: 2.1 time: 0.189844 Sep 07 19:15:17.245714 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 62/130] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:17 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:18.065226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:18.066605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:18.074209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:18.074926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:18.081235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.082157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.082801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.083736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.084454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.085024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.088763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.090827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.090827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.091012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:18.091110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.094729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.095300 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.431904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:18.440673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:18.442391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:18.443640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4c766b0b-439c-4b65-aa6c-fe6c29033287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.373848 Sep 07 19:15:18.444802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 63/131] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:18 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:18.449504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:18.450365 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:18.457611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.458362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.459025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.459938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:18.460620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:18.461278 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:18.500070 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:18.510617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e5619f20-af27-44c8-a7b8-78bc77dd3e90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.450403 Sep 07 19:15:18.511756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 69/132] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:18 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:18.610976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:18.618668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ca157ca1-5431-4326-b299-48f1805bae92 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1502 microversion: 2.1 time: 0.172684 Sep 07 19:15:18.619237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 64/133] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:18 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:19.148970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f3725f-cd16-4277-be1b-ef47b8c92ca0", "name": "network-vif-plugged", "status": "completed", "tag": "13fb3160-88c3-471a-834d-9476f251fa88"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:19.162117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:19.162623 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:19.163230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:19.174951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] Creating event network-vif-plugged:13fb3160-88c3-471a-834d-9476f251fa88 for instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 on hv-cinder-84773 Sep 07 19:15:19.180322 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fe2ebc82-b3e5-4927-be31-8065652f8987 req-836a9baf-7c1e-4cef-93ce-d6ecfb245105 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 Sep 07 19:15:19.180908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 70/134] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:15:19.484967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:19.484967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:19.486147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:19.486889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:19.487524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:19.488434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:19.489068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:19.489781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:19.538502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:19.539669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:19.548568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:19.549292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:19.549890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:19.550940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:19.551643 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:19.552234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:19.761004 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:19.777379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:19.778870 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:19.780103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-02d8d168-54cc-47ef-81f0-fc22ed2571c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.306688 Sep 07 19:15:19.787759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 65/135] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:19 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:15:19.821056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:19.830757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6ad53e58-beb6-4bfa-af92-8d7cca7eea90 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.300024 Sep 07 19:15:19.831429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 71/136] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:19 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:20.667252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "579dc05d-5212-4963-a98b-aae23adb7bce"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:20.669774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:20.677716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:20.678282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:20.678655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:20.685099 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:20.685099 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:20.685099 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:20.821287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:20.822636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:20.831198 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:20.833096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:20.835475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:20.837134 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:20.842249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:20.846779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:21.067704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:21.081169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:21.081169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:21.081566 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a7787f20-4237-4828-a6a9-f479d1587489 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1405 microversion: 2.20 time: 0.265752 Sep 07 19:15:21.082307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 72/137] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:20 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:21.086917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:21.087769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:21.094499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:21.095231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:21.095764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:21.096759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:21.097276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:21.097716 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:21.324417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:21.337525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38cdbaac-d117-41f3-a00d-84c92e1f897c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.253981 Sep 07 19:15:21.338721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 73/138] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:21 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:22.110053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:22.110925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:22.126143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.126143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.126143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.126143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.126430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.126430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.298345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db83ec6a-1a33-4ae5-b4f8-15b63f4ba9fa tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "POST /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.634805 Sep 07 19:15:22.298974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 66/139] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:15:20 2022] POST /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9/os-volume_attachments => generated 194 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:15:22.303279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:22.319469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:22.321464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:22.322827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6eed311d-f5b3-4dea-bba4-befc470a6486 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1597 microversion: 2.20 time: 0.217517 Sep 07 19:15:22.338695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 74/140] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:15:22 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1597 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:15:22.354322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:22.354957 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:22.368365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:22.368365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:22.368556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.368556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.368556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.368556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.368835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.368835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.381701 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.382224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.382805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.383788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:22.384381 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:22.386366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:22.487135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b3e6e7b6-d451-4ec3-991c-6272e96a8744 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.139518 Sep 07 19:15:22.488090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 67/141] 10.222.0.46 () {60 vars in 1316 bytes} [Wed Sep 7 19:15:22 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:15:22.624095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:22.635259 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a9ca52a-b08b-4f36-9ad2-1a9c1bcc18aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1321 microversion: 2.1 time: 0.275720 Sep 07 19:15:22.647013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 75/142] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:22 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:23.663233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:23.663832 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:23.670752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:23.671293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:23.671735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:23.677256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:23.677256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:23.677256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:23.856835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:23.864694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-df4e1357-82d6-4612-995a-164483ca73aa tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1514 microversion: 2.1 time: 0.206193 Sep 07 19:15:23.866806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 68/143] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:23 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:23.892635 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:23.895611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:23.901543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:23.902826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:23.903154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:23.903920 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:23.904939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:23.905369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:23.967184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'flavor' on Instance uuid 88f3725f-cd16-4277-be1b-ef47b8c92ca0 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:15:24.318570 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:24.328318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:24.329025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:24.329452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:24.340934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] Creating event network-changed:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:15:24.347843 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-37fadd30-0a63-4f39-96ee-caaa1b7a1b25 req-fbab9740-5eb0-474f-b38b-4d94266d2682 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032428 Sep 07 19:15:24.349407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 69/144] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:15:24.374757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a3c0bc6f-ec36-4fcc-8e71-13c121f9a811 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0/action" status: 200 len: 32 microversion: 2.1 time: 0.486040 Sep 07 19:15:24.376063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 76/145] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:15:23 2022] POST /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:15:24.385486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:24.386193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:24.422097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:24.422097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:24.422097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:24.422097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:24.422399 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:24.422474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:24.664969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:24.682074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d95aa80d-afdf-4c1d-98df-bc54844b370e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.300560 Sep 07 19:15:24.684520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 70/146] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:24 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:25.706619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:25.708668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:25.716220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:25.717661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:25.718307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:25.719353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:25.720050 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:25.720661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:26.072919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:26.081251 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6ccf9eb5-9348-43f6-85b3-8e3dbeb1c9ee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.379221 Sep 07 19:15:26.081836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 77/147] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:25 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:27.104989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:27.106117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:27.112926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:27.113935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:27.114365 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:27.115084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:27.115526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:27.115944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:27.246210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:27.254577 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c9feaf99-9d34-46fe-856f-ecb25fd8eb4e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.153460 Sep 07 19:15:27.255147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 71/148] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:27 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:28.277207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:28.279717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:28.284149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:28.284633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:28.285069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:28.285756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:28.286206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:28.286682 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:28.429676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:28.437595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4426c05e-dc06-427c-bd73-f02d1904ae74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.164458 Sep 07 19:15:28.438178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 78/149] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:28 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:29.465096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:29.465775 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:29.472787 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:29.473368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:29.473801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:29.474501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:29.474976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:29.475397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:29.611087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:29.618954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f621803-e483-4eea-bcc0-d97ea4844823 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.157836 Sep 07 19:15:29.619525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 72/150] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:29 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:30.642218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:30.642854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:30.649417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:30.650178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:30.650628 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:30.658003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:30.658529 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:30.658982 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:30.800441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:30.809183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-56be642f-13fb-4e88-832c-8d83acc8fd52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.170486 Sep 07 19:15:30.809598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 79/151] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:30 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:31.833974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:31.835016 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:31.843349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:31.843869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:31.844304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:31.847190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:31.847190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:31.847190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:31.976520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:31.985005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4419dd56-e9cf-449b-b685-59aaf478e58a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.156219 Sep 07 19:15:31.985574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 73/152] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:31 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:33.008662 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:33.011103 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:33.019821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:33.020384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:33.020846 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:33.021556 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:33.022252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:33.022915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:33.307604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:33.318565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d6d84aa-0f3d-471f-9a1b-88f93494ced4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.312195 Sep 07 19:15:33.319766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 80/153] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:33 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:34.349077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:34.350945 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:34.380203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:34.380701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:34.381137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:34.381847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:34.382295 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:34.382848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:34.408469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:34.538318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:34.546839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec82c6fa-d77c-4abd-93fb-178293cc619c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.205230 Sep 07 19:15:34.562723 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 74/154] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:34 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:35.571239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:35.572425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:35.579187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=55 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:35.580944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:35.581842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:35.582444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:35.583369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:35.583993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:35.584416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:35.724313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:35.750444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2add1a66-69b2-4946-8bb3-fe6270a7cfb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.182911 Sep 07 19:15:35.751497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 81/155] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:35 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:36.773576 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:36.774194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:36.781360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:36.781815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:36.782252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:36.782980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:36.783435 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:36.783922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:36.927052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:36.935260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-870ae0d4-f0ed-424e-a89c-a598e1119986 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.165235 Sep 07 19:15:36.935831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:36 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:37.521166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:37.521733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:37.528925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.529818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.535605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:37.535605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.535605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.535605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:37.560991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:15:37.683187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:37.950647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-629b436f-0d9d-471e-9fe9-8ffa16c16fec tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 204 len: 0 microversion: 2.1 time: 0.432795 Sep 07 19:15:37.951745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 82/157] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:15:37 2022] DELETE /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:15:37.959047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:37.960375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:37.960486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:37.961110 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:37.968437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.968927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.969529 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:37.970014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.970734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.972143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:37.972464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.972934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.973852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:37.974069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:37.974770 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:37.975421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:38.207477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:38.209732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:38.219921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eb9b23f4-b06d-4cfa-854c-50e59c2a9abe tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.265213 Sep 07 19:15:38.223768 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 76/158] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:37 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:38.242218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78923314-8c28-4ced-8608-d8901b5fb4a8 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1554 microversion: 2.1 time: 0.286160 Sep 07 19:15:38.242841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 83/159] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:37 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1554 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:39.245893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:39.246586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:39.249219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:15:39.254032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:39.254613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:39.254985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:39.255676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:39.256130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:39.256554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:39.264602 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:39.265212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:39.271989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:39.272469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:39.272904 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:39.273593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:39.274037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:39.274458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:39.457424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:39.465470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0884b387-6cbd-47ea-b513-601659361a52 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.223378 Sep 07 19:15:39.466704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 77/160] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:39 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:39.498282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:39.506337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32ddebd2-6ef2-4d84-876a-59efe0ed590c tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1554 microversion: 2.1 time: 0.245628 Sep 07 19:15:39.507087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 84/161] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:39 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:40.490694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:40.491335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:40.498405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:40.498967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:40.500062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:40.501286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:40.501937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:40.503306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:40.530257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:40.530903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:40.537433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:40.537971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:40.538405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:40.539137 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:40.539588 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:40.544403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:40.760699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:40.777270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:40.779030 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-663f7abc-8644-4072-a52b-9a1ddd9df094 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.292452 Sep 07 19:15:40.779648 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 78/162] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:40 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:40.786326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31b41a44-fb48-44e3-a117-4bab9b016dbf tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1554 microversion: 2.1 time: 0.260899 Sep 07 19:15:40.787231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 85/163] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:40 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:15:41.426237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9", "name": "network-vif-deleted", "tag": "c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:15:41.436928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:41.437412 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:41.437836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:41.451109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] Creating event network-vif-deleted:c552d439-112c-4b3d-b7c9-7cd4f8b0cbd0 for instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 on hv-cinder-84773 Sep 07 19:15:41.456878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-caf31000-bc8e-47e7-98ef-a9bf1b84d632 req-c7975431-f654-4f22-86c9-5fad1d2575de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Sep 07 19:15:41.457754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 79/164] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:15:41.802314 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:41.802955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:41.809583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:41.810090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:41.819730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:41.819730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:41.819730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:41.819730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:41.820397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:41.820397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:41.821724 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:41.822214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:41.822684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:41.823376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:41.823815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:41.824544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:41.939108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:41.950213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fa23d869-0336-4bd1-9dd1-3de0bf87665f tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1345 microversion: 2.1 time: 0.141222 Sep 07 19:15:41.970749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 80/165] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:41 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:42.050487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:42.058422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac02f761-5072-4d01-a211-e44dc53a7a1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.259955 Sep 07 19:15:42.059544 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 86/166] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:41 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:42.978010 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:42.978722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:42.988183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:42.992771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:42.992771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:42.992771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:42.992771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:42.994287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:43.030428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:43.031086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:43.031615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:43.032305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lazy-loading 'fault' on Instance uuid a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:15:43.090032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:43.090032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:43.100894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:43.101388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:43.101922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:43.102504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:43.103161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:43.103583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:43.116315 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddf07a7d8aed4b3faf058c66347cf315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e10ea750ae4455b7bc482b0db2ce6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:43.126959 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6846ff2a-756a-4346-bd20-0eb6f5cef393 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 200 len: 1350 microversion: 2.1 time: 0.153504 Sep 07 19:15:43.127642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 81/167] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:42 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:43.381498 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:43.407202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-534793a9-276f-4ecb-b265-9dcf057f0900 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.327763 Sep 07 19:15:43.425014 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 87/168] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:43 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:44.150086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:44.150723 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:44.157280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.157755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.158188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.158905 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.159354 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.159771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.173872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] HTTP exception thrown: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Request method failure captured: Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 HTTP/1.1 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dV2rqCuZXsPnb5SMpR_Ir6VwpGBaaPaRPHPxpGWnZz8mIBPDEd-U-33U4eXufveUj55IRjfcO5glPrRuVyiOe2y507imRT3HIsKDwUElhgScxNdfxtrZg3C8DJmnuTjq5COXDeVt_cN-s95gIummPyhDzu2YXpImo8sdO6Hl_ql4 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:15:44.178539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: ddf07a7d8aed4b3faf058c66347cf315 Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.179962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9'} Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:15:44.180660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.181938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.182977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Returning 404 to user: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:15:44.182977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-86ae5320-55f2-4d1a-9af3-40e3b9167f35 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 404 len: 111 microversion: 2.1 time: 0.033898 Sep 07 19:15:44.182977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 82/169] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:44 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:15:44.309781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:44.312048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:44.318005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.318497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.319435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.320595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.321052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.321516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.334336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] HTTP exception thrown: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Request method failure captured: Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9/os-volume_attachments HTTP/1.1 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2dV2rqCuZXsPnb5SMpR_Ir6VwpGBaaPaRPHPxpGWnZz8mIBPDEd-U-33U4eXufveUj55IRjfcO5glPrRuVyiOe2y507imRT3HIsKDwUElhgScxNdfxtrZg3C8DJmnuTjq5COXDeVt_cN-s95gIummPyhDzu2YXpImo8sdO6Hl_ql4 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:15:44.338612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: ddf07a7d8aed4b3faf058c66347cf315 Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.343837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'server_id': 'a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9'} Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:15:44.344580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:44.345864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:15:44.347228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Returning 404 to user: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:15:44.347228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4896047a-954f-428c-8ed3-2135abb575b2 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034341 Sep 07 19:15:44.347228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 88/170] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:15:44 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:15:44.429516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:44.430701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:44.438826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.439643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.440224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.441207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:44.442071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:44.442681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:44.615565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:44.624651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f652010f-5795-43f2-96d9-65670296a803 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.198756 Sep 07 19:15:44.641553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 83/171] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:44 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:45.649484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:45.650293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:45.657877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.658530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.659209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.659898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.660345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.660763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.793906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:45.795033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:45.803623 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.804323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.804946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.805986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.807115 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.807713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.823692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] HTTP exception thrown: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Request method failure captured: Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 HTTP/1.1 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dV2rqCuZXsPnb5SMpR_Ir6VwpGBaaPaRPHPxpGWnZz8mIBPDEd-U-33U4eXufveUj55IRjfcO5glPrRuVyiOe2y507imRT3HIsKDwUElhgScxNdfxtrZg3C8DJmnuTjq5COXDeVt_cN-s95gIummPyhDzu2YXpImo8sdO6Hl_ql4 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:15:45.825312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: ddf07a7d8aed4b3faf058c66347cf315 Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.831364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9'} Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:15:45.832025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.833059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.834245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Returning 404 to user: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:15:45.834245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-43064f94-997a-4f47-9603-a8352c094fb0 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 404 len: 111 microversion: 2.1 time: 0.038204 Sep 07 19:15:45.834245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:15:45 2022] DELETE /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:15:45.834823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:45.836555 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:45.837159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] [instance: a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:45.843531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.844013 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.844620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.844862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-936ec4df-28d9-48f0-8320-e48b33f288a1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.199615 Sep 07 19:15:45.845313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:45.845660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 89/173] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:45 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:45.845778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:45.846178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:45.864580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] HTTP exception thrown: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Request method failure captured: Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 HTTP/1.1 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dV2rqCuZXsPnb5SMpR_Ir6VwpGBaaPaRPHPxpGWnZz8mIBPDEd-U-33U4eXufveUj55IRjfcO5glPrRuVyiOe2y507imRT3HIsKDwUElhgScxNdfxtrZg3C8DJmnuTjq5COXDeVt_cN-s95gIummPyhDzu2YXpImo8sdO6Hl_ql4 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:15:45.866305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d3e10ea750ae4455b7bc482b0db2ce6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: d3e10ea750ae4455b7bc482b0db2ce6d Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-DeleteServersTestJSON-1948896767 Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: ddf07a7d8aed4b3faf058c66347cf315 Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-DeleteServersTestJSON-1948896767-project Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.867691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9'} Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:15:45.868534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. Sep 07 19:15:45.869781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:15:45.871915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] Returning 404 to user: Instance a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:15:45.872765 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4a287813-109d-48c1-a872-2a0b91902ad5 tempest-DeleteServersTestJSON-1948896767 tempest-DeleteServersTestJSON-1948896767-project] 10.222.0.46 "GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9" status: 404 len: 111 microversion: 2.1 time: 0.039895 Sep 07 19:15:45.873350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 85/174] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:45 2022] GET /compute/v2.1/servers/a5c6eb2d-fe3d-46fb-bde5-cb372c7eb7f9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:15:46.869814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:46.870423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:46.879006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:46.884908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:46.884908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:46.884908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:46.884908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:46.889079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:47.113380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:47.134953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fe30bb82-8bc6-42e0-840e-b512e7754231 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.266367 Sep 07 19:15:47.134953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 90/175] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:46 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:48.159550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:48.160185 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:48.166352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:48.166862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:48.167286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:48.173858 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:48.174346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:48.174844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:48.459725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:48.474418 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f3be836-0ab9-4a38-8eef-8b8ba9a6bc09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.318653 Sep 07 19:15:48.484748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 86/176] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:48 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:49.510914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:49.510914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:49.511392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:49.511538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:49.512666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:49.517132 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:49.521200 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:49.521837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:49.853768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:49.875116 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a1dace19-2193-4018-85ac-c2e689ad90e4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.379080 Sep 07 19:15:49.875704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 91/177] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:49 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:50.910239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:50.913019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:50.919218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:50.919699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:50.920130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:50.920823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:50.921268 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:50.921685 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:51.116823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:51.125157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-73ca98a3-98fc-4bab-82b8-1e9676f2fd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.219993 Sep 07 19:15:51.125728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 87/178] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:50 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:52.149686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:52.150377 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:52.160080 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:52.161102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:52.161245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:52.162106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:52.162704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:52.163170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:52.328542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:52.336366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ac1761f-53b2-4d03-9844-a381a1d08521 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.191138 Sep 07 19:15:52.336940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 92/179] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:52 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:53.361260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:53.361260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:53.370401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:53.370933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:53.371375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:53.372090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:53.372969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:53.374000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:53.557940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:53.566958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-791dea94-0499-42a9-8f43-f2e5387ff3b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.210303 Sep 07 19:15:53.567824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 88/180] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:53 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:54.593684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:54.594525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:54.601214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:54.607510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:54.608185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:54.609327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:54.609983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:54.610723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:54.795600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:54.803801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-deb201cd-42e3-45c7-ad74-5c384232811f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.215123 Sep 07 19:15:54.804378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 93/181] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:54 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:55.828167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:55.828778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:55.835157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:55.835652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:55.836091 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:55.837022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:55.837476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:55.838093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:55.979294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:55.987383 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f8e42946-45a2-4aa7-8256-b39ef4eee0ec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.164269 Sep 07 19:15:55.987944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 89/182] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:55 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:57.018815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:57.018815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:57.022400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:57.022400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:57.023775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:57.024419 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:57.032886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:57.032886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:57.432357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:57.441075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b228f5a5-790b-4aad-9aea-2da48a6dbd1e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.433483 Sep 07 19:15:57.442218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 94/183] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:57 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:58.464825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:58.465499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:58.471913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:58.472410 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:58.472834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:58.473528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:58.473983 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:58.474415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:58.601516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:58.609991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f160eb4c-d199-4522-9240-58da817429f1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.148998 Sep 07 19:15:58.610574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 90/184] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:58 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:15:59.633268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:15:59.633795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:15:59.640348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:59.640826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:59.641260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:59.641948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:15:59.642398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:15:59.642856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:15:59.781628 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:15:59.789356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-abfa4558-c5b0-43ea-b720-b4429d434c1d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.160090 Sep 07 19:15:59.789928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 95/185] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:15:59 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:00.813992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:00.814635 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:00.821162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:00.821647 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:00.822086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:00.822816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:00.823769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:00.824232 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:00.951475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:00.959055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13d17a12-1ac1-47e1-b9d6-31829e690f16 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.148912 Sep 07 19:16:00.959624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 91/186] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:00 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:01.983476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:01.984081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:01.990137 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:01.990722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:01.991180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:01.991867 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:01.992280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:01.992889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:02.135073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:02.143676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-30ebd02f-c17e-49e1-9ece-c5de08580ce0 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.164846 Sep 07 19:16:02.146610 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 96/187] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:01 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:03.168530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:03.169323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:03.176091 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:03.176738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:03.177224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:03.178402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:03.178925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:03.179537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:03.326859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:03.334872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18613224-f9e2-4b76-927a-33064378b704 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.170436 Sep 07 19:16:03.335440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 92/188] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:03 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:04.359963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:04.360565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:04.366583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:04.367090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:04.367548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:04.368230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:04.368733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:04.369150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:04.519838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:04.530352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8d31d3e3-e77f-4c89-8861-38ceb1a43389 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.174364 Sep 07 19:16:04.531184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 97/189] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:04 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:05.564320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:05.564876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:05.571242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:05.571730 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:05.572165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:05.572857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:05.573311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:05.573731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:05.593022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:05.736562 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:05.743954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f4ec1490-1295-4bc8-b43a-ca143b1f83ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.183695 Sep 07 19:16:05.745200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 93/190] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:05 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:06.772881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:06.773484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:06.780192 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:06.780665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:06.781098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:06.781775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:06.782220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:06.782660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:06.948974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:06.957209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fa5c408c-79d3-4ad9-b592-861f3a95c90b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.188162 Sep 07 19:16:06.957785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 98/191] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:06 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:07.981933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:07.982641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:07.990876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:07.990876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:07.990876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:07.990876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:07.991384 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:07.991810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:08.136081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:08.143715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-095e2404-c271-4d0d-a9e5-866c6813479c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.166511 Sep 07 19:16:08.144274 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 94/192] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:07 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:09.169531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:09.170228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:09.172178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:09.176832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:09.179211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:09.179211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:09.179211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:09.179211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:09.179559 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:09.326823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:09.341404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-27a3f122-9e00-44bb-bf7a-d8063adc59ae tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.172770 Sep 07 19:16:09.341404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 99/193] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:09 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:10.361134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:10.361737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:10.368570 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:10.368979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:10.369411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:10.370093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:10.370542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:10.371497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:10.578793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:10.586754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4ea4f967-be02-4896-b6a9-6eb1c750ec09 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.229470 Sep 07 19:16:10.587425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 95/194] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:10 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:11.408471 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:11.408963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:11.415169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:11.415646 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:11.416075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:11.416754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:11.417200 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:11.417617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:11.422231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=99 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:11.443039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7599756-ae82-4162-9851-5cf198319b80 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/ips" status: 200 len: 152 microversion: 2.20 time: 0.038676 Sep 07 19:16:11.443614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 100/195] 10.222.0.46 () {60 vars in 1289 bytes} [Wed Sep 7 19:16:11 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:16:11.611233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:11.611819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:11.614205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=40 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:11.618895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:11.619397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:11.619815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:11.620514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:11.621593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:11.622023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:11.773061 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:11.778876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-567335c1-23b6-41d5-ba58-d547ffdb0b1c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.171399 Sep 07 19:16:11.779433 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 96/196] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:11 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:12.802136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:12.803384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:12.809542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:12.811657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:12.811657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:12.811657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:12.811657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:12.812027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:12.968392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:12.976608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd7a9d29-4d71-4e34-82d9-3adeace40aac tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.178727 Sep 07 19:16:12.977534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 101/197] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:12 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:14.001321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:14.002224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:14.009603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:14.010316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:14.010794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:14.011602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:14.012258 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:14.012856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:14.165619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:14.175175 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d006e824-80a0-4eab-b489-ad30a0328dd2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.178259 Sep 07 19:16:14.175916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 97/198] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:13 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:14.820068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:14.823966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:14.832154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:14.832876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:14.833316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:14.834016 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:14.834522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:14.834958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:14.859740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'flavor' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:16:15.198098 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:15.199803 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:15.206783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:15.207328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:15.207824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:15.208574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:15.209265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:15.209847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:15.366143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:15.374965 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c001b396-49ad-409a-9fa1-32f32c2eb642 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.180751 Sep 07 19:16:15.375981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 98/199] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:15 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:16.398740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:16.399407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:16.406816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:16.407560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:16.407991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:16.408698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:16.409145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:16.409559 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:16.548138 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:16.556868 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-24c8c17b-8cc6-4081-81d8-bbbc063718a5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.162041 Sep 07 19:16:16.557449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 99/200] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:16 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:16.967435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b7beb498-e40d-4980-838b-94d1f6a196e3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/action" status: 202 len: 0 microversion: 2.20 time: 2.151423 Sep 07 19:16:16.969148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 102/201] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Sep 7 19:16:14 2022] POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/action => generated 0 bytes in 2154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:16:16.984750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:16.984750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:16.984951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:16.985310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:16.985738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:16.986429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:16.988370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:16.988801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:17.132782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:17.141620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:17.145551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:17.145551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f4eb06e-e3a6-4914-b2c0-ea032d297fb0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.170743 Sep 07 19:16:17.145551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 100/202] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:16 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:17.586398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:17.587151 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:17.597897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:17.598398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:17.598879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:17.601289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:17.601776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:17.602252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:17.827986 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:17.837409 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9fc2ed6d-1045-45c3-9d37-d78e6a89de05 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.256391 Sep 07 19:16:17.838112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 103/203] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:17 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:18.170704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:18.171241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:18.178155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:18.178760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:18.179305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:18.180225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:18.180913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:18.181420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:18.334974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:18.343816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:18.345272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:18.346681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3f16bd77-4eb0-4d45-b20d-950e515e5df4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.179996 Sep 07 19:16:18.347576 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 101/204] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:18 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:18.863092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:18.863613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:18.883077 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:18.883077 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:18.884534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:18.885391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:18.885860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:18.886297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:19.072495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:19.081133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7bfbeaf4-1ab6-4670-b3c3-e35c495f252c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1520 microversion: 2.1 time: 0.222327 Sep 07 19:16:19.088977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 104/205] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:18 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:19.371811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:19.372375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:19.378914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:19.383464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:19.383464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:19.383464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:19.383464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:19.383847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:19.519281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:19.530203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:19.531952 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:19.533069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c8d8213d-b442-4cd7-99a6-0a27bca900e4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.165172 Sep 07 19:16:19.546784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 102/206] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:19 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:20.104234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:20.105172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:20.111581 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.112072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.115917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.115917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.115917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.115917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.267935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:20.276296 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d7feec1-0d20-4124-9c0f-f8881efd941e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1500 microversion: 2.1 time: 0.175887 Sep 07 19:16:20.277074 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 105/207] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:20 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:20.298982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:20.299593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:20.305406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.305886 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.306316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.307035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.307490 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.308574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.441783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:20.449942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-846b9cab-c3bb-429d-8d45-07cc0c7870b1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1515 microversion: 2.1 time: 0.154704 Sep 07 19:16:20.450506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 103/208] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:20 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:20.559402 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:20.560088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:20.565962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.566680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.567370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.568007 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:20.568461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:20.568876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:20.704880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:20.713293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:20.715279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:20.716435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae177529-8815-406b-991e-6ed92b508efc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.161533 Sep 07 19:16:20.717224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 106/209] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:20 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:21.330659 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-815633895", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "networks": [{"uuid": "24a2b4d6-7c2b-4cf8-a4af-cfdccace73b9"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:21.395751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] validate_networks() for [('24a2b4d6-7c2b-4cf8-a4af-cfdccace73b9', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:16:21.743136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:21.744476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:21.752477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:21.752477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:21.752933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:21.753802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:21.754511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:21.755107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:21.771778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:16:21.772291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:16:21.772663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:16:21.773068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:16:21.773482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:16:21.787763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:21.788489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:21.789079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:21.789976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:21.797923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:21.798413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:21.817507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Getting quotas for project 702737b15c8e484d8aba627563179edf. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:16:21.821669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Getting quotas for user 54bff8714b5b4f0d96b8fbeda69e4e98 and project 702737b15c8e484d8aba627563179edf. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:16:21.835532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:16:21.837863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:16:21.922728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:21.930812 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:21.932254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:21.934257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-926e0988-db78-4d03-aeda-b097e1e97711 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.195009 Sep 07 19:16:21.934849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 107/210] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:21 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:21.984284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-558a8d92-1233-4d43-b6c8-37812a9c1578 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657715 Sep 07 19:16:21.985400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 104/211] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:16:21.997771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd930266-a80b-4926-989a-a54904781ddd tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:21.998650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd930266-a80b-4926-989a-a54904781ddd tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:22.059528 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd930266-a80b-4926-989a-a54904781ddd tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:22.067351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd930266-a80b-4926-989a-a54904781ddd tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1213 microversion: 2.1 time: 0.074484 Sep 07 19:16:22.068202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 108/212] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:21 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:22.960023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:22.960651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:22.967766 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:22.968316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:22.968676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:22.969371 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:22.969826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:22.970255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:23.092064 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:23.092817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:23.098924 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:23.100068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:23.100068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:23.100461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:23.100945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:23.101337 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:23.101469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:23.110772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:23.112522 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:23.113929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e187e1d0-4518-47c6-bb46-0940f9cb99cc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.157853 Sep 07 19:16:23.114493 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 105/213] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:22 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:23.166744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:23.175110 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e906322e-8bda-4b36-ad36-b8b80216bfae tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1217 microversion: 2.1 time: 0.088258 Sep 07 19:16:23.175680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 109/214] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:23 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:24.141358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:24.141998 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:24.148563 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:24.149043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:24.149472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:24.150414 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:24.150894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:24.151316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:24.197728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:24.198340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:24.204377 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:24.205093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:24.205280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:24.205978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:24.206431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:24.206882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:24.304247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:24.313739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f59c9898-7513-40de-8589-fdcb10a0a1a8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1217 microversion: 2.1 time: 0.119957 Sep 07 19:16:24.315107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 110/215] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:24 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:24.351628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:24.355098 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:24.356635 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:24.357779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5b6b7929-9e25-4d21-bf0b-03052f66e9a2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.220388 Sep 07 19:16:24.358333 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 106/216] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:24 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:25.345652 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:25.346262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:25.352582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.353087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.353732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.354626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.355241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.370683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.384817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:25.391632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:25.414642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.414795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.415383 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.416087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.416532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.416946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.435742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:25.444309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-69ae71e4-2f85-41a0-8b09-7af84c00ade8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1273 microversion: 2.1 time: 0.102175 Sep 07 19:16:25.444736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 111/217] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:25 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:25.493597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:25.498009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:25.506435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.506435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.506435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.506435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.506902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.507183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.542161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'flavor' on Instance uuid ca91c2bd-b822-4ce2-82fa-605aea3fb036 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:16:25.587903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:25.596634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:25.598081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:25.599269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e717bb0-e1ee-4e61-8dd7-66b2a25585b7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.218751 Sep 07 19:16:25.599837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 107/218] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:25 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:25.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8c835f1-c566-4064-9568-43db8abd981b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/action" status: 200 len: 32 microversion: 2.1 time: 0.369200 Sep 07 19:16:25.859156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 112/219] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:16:25 2022] POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:16:25.868327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:25.869082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:25.875738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.876285 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.876633 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:25.877440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:25.877923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:25.878348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:26.057461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:26.066672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f6c3919-1815-4614-b0ce-c91f092a4c44 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.202143 Sep 07 19:16:26.067305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 108/220] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:25 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:26.472118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:26.472944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:26.482848 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:26.484906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:26.485416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:26.486293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:26.487091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:26.487590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:26.625581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:26.626283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:26.641190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:26.641743 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:26.643066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:26.643789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:26.644237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:26.644655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:26.741817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:26.750418 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b6add35-6485-4215-86f3-e480026f6e81 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.282548 Sep 07 19:16:26.753254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 113/221] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:26 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:26.851479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:26.862605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:26.864181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:26.865499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13268cf5-01c5-4a0b-b8f2-19206c103bb3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.244111 Sep 07 19:16:26.866058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 109/222] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:26 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:27.096902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:27.098413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:27.103594 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.104156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.104603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.105320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.105782 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.106205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.110334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:27.251158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:27.258784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f83d8a2a-a4b6-4fd6-a320-a8ee923e627b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.165591 Sep 07 19:16:27.268249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 114/223] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:27 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:27.331025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0eddda-a69a-4412-85d4-31076491e1e5", "tag": "62bc09b9-4a6a-4421-a958-04c0eebcdb3a"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:27.349249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.349904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.350428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.364088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] Creating event network-changed:62bc09b9-4a6a-4421-a958-04c0eebcdb3a for instance ac0eddda-a69a-4412-85d4-31076491e1e5 on hv-cinder-84773 Sep 07 19:16:27.369680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-0c73b6f7-b83c-4a34-85df-28d73ca65299 req-ac92d5bb-d1bf-4622-9804-5e0630c5d417 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042871 Sep 07 19:16:27.370479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 110/224] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:16:27.773756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:27.774378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:27.781537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.782021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.782487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.783242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.783807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.784241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.894896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:27.895787 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:27.902486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.903239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.903832 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.905220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:27.905796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:27.906332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:27.926424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:27.939060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8361d333-c611-4157-8493-8c30fb475a0b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.169477 Sep 07 19:16:27.941349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 115/225] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:27 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:27.954585 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:28.094688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:28.110935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:28.114216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:28.115782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-106d68c9-368e-4884-ae22-562adf6789f6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.228051 Sep 07 19:16:28.117385 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 111/226] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:27 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:28.284023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:28.284754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:28.291353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:28.291840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:28.292278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:28.293624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:28.294078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:28.294502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:28.481002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:28.489511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5b456842-46bd-452d-8ef1-9120d83a9185 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.209871 Sep 07 19:16:28.490063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 116/227] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:28 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:28.970863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:28.971530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:28.978374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:28.978896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:28.979367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:28.980059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:28.981157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:28.981585 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:29.115742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:29.124511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8924a3c4-0526-4313-b600-445597f9eab7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.158891 Sep 07 19:16:29.125086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 112/228] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:28 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:29.142908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:29.143521 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:29.149633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:29.150536 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:29.150819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:29.151513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:29.151967 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:29.152419 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:29.300294 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:29.309836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:29.311363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:29.313453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-050f68f9-8199-490b-bcec-9a1fb7eba794 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.173782 Sep 07 19:16:29.314855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 117/229] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:29 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:29.511723 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:29.512337 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:29.518208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:29.518739 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:29.519180 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:29.519891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:29.520346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:29.520769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:29.654192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:29.661861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe115f4b-5e05-4c02-a078-dd742ad951b9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.154024 Sep 07 19:16:29.662428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 113/230] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:29 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:30.147911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:30.148512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:30.155703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.156174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.156598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.157273 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.157718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.158133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.290438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:30.302121 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fb42a77f-b3ac-4f9f-8d4b-35c19c01faea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.154673 Sep 07 19:16:30.302121 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 118/231] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:30 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:30.343241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:30.343802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:30.349874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.350364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.351096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.351824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.352281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.352727 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.688342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:30.696619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:30.697442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:30.706625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:30.706625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:30.707030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.707133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef7af392-ed64-4d62-952a-065e800a2a61 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.368898 Sep 07 19:16:30.707234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.707234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.707416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 114/232] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:30 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:30.707674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:30.708297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:30.708729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:30.848907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:30.859387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8eaffd5-d58c-4b8a-8ed4-36a92e4065ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.164700 Sep 07 19:16:30.859387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 119/233] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:30 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:31.323043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:31.323718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:31.330375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.330952 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.331461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.332029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.332622 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.333048 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.478860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:31.487457 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-86857fd6-15b8-490a-b5d2-386879b2b8e2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.168234 Sep 07 19:16:31.488107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 115/234] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:31 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:31.731519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:31.732130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:31.738954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.739431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.739863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.740547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.740997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.741592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.879854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:31.880473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:31.882293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:31.886512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:31.888578 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:31.893938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.895209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.895768 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.896612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:31.896762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:31.897256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:31.897824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:31.898331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:31.900164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-07b26fde-d9b1-433a-b63e-3a3fa33248c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.172711 Sep 07 19:16:31.900736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 120/235] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:31 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:32.033971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:32.041785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5324bc79-89b5-4842-9c9d-b8b1f73d0743 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.165806 Sep 07 19:16:32.042347 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:31 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:32.532433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:32.533036 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:32.534855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:32.539783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:32.540264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:32.540693 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:32.541375 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:32.541827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:32.542242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:32.671843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:32.679673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f47b1798-33dd-429c-919e-c65f9cad47d1 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.151947 Sep 07 19:16:32.680239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 121/237] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:32 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:32.926804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:32.928068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:32.935055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:32.935713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:32.936156 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:32.936839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:32.937282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:32.937701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:33.065294 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:33.066015 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:33.067029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:33.072232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:33.072721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:33.073161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:33.073858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:33.074312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:33.075258 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:33.075890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:33.077316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:33.078467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-254d4075-f86c-4eee-b560-45f99ad3b957 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.156930 Sep 07 19:16:33.079073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 117/238] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:32 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:33.212658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:33.223695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b1d10585-fe25-4f76-ad2c-9d2472b2b4e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.162339 Sep 07 19:16:33.225032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 122/239] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:33 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:33.703710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:33.704319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:33.710194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:33.710706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:33.711140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:33.711826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:33.712293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:33.712693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:33.870943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:33.879617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a521528f-9bf0-4cea-9a69-5b4c07c0b688 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.180602 Sep 07 19:16:33.880191 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 118/240] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:33 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:34.104437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:34.105047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:34.111783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.112262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.112690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:34.113379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.113826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.114244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:34.247559 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:34.249516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:34.251013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:34.257670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.258699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.259213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:34.259334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:34.260108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.260619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.260735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:34.261197 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:34.262260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48dda14c-365e-49fa-984f-6d8729081a64 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.161887 Sep 07 19:16:34.274789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 123/241] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:34 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:34.403261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:34.413098 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c29f101-6213-4b59-8133-65c58ad38846 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.169532 Sep 07 19:16:34.414202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 119/242] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:34 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:34.903934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:34.904671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:34.911624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.912129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.912973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:34.913653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:34.914472 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:34.915136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:35.075173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:35.083111 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9ae6b45-b4cd-4d98-99e4-d8aed2051cf7 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.183470 Sep 07 19:16:35.083886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 124/243] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:34 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:35.293520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:35.296431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:35.313262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:35.313931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:35.315196 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:35.317519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:35.317980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:35.324096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:35.438345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:35.439491 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:35.449975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:35.450825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:35.451359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:35.452741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:35.453415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:35.454056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:35.496708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:35.524751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:35.527319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:35.528544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d11f15f8-6928-4e59-9dea-9dde62787c0d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.241725 Sep 07 19:16:35.529109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 120/244] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:35 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:35.594820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:35.602792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6092bc37-e3eb-41a2-af26-c871f1083592 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.169647 Sep 07 19:16:35.603372 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 125/245] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:35 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:36.107859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:36.108745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:36.116697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.117605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.118036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.118809 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.119243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.119663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.298356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:36.314564 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-56fae140-7470-43bf-8796-417a95d658a5 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.212497 Sep 07 19:16:36.316262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 121/246] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:36 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:36.554946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:36.555597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:36.562916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.563402 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.563831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.564521 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.565164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.565585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.630345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:36.630345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:36.636776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.637271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.637916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.639267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:36.640092 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:36.640708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:36.904747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:36.922923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:36.928245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:36.928245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e34be4bf-90ed-4334-a8d9-5d9ddc6a7e1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.376114 Sep 07 19:16:36.929280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:36.930281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 126/247] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:36 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:36.937558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f6813c3f-8979-46b5-8734-d1b801b9075c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.315867 Sep 07 19:16:36.938117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 122/248] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:36 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:37.023728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0eddda-a69a-4412-85d4-31076491e1e5", "name": "network-vif-plugged", "status": "completed", "tag": "62bc09b9-4a6a-4421-a958-04c0eebcdb3a"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:37.040268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.040935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.043545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.056343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] Creating event network-vif-plugged:62bc09b9-4a6a-4421-a958-04c0eebcdb3a for instance ac0eddda-a69a-4412-85d4-31076491e1e5 on hv-cinder-84773 Sep 07 19:16:37.062620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-a96e05ee-bb36-4336-aa1b-7839f77d12df req-b8a55f83-8ecc-4e85-9160-aa43edd8270d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042815 Sep 07 19:16:37.063313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 127/249] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:16:37.343182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:37.343850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:37.361357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.362593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.362593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.366490 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.368053 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.368910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.541554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:37.550034 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a841acbe-9918-4a7d-ad27-7e6d27c93e3c tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.215521 Sep 07 19:16:37.550695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 123/250] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:37 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:37.961057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:37.961188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:37.961665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:37.962149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:37.972493 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.974829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.975280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.976002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.976380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.976487 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.976854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.976964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.977384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:37.978082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:37.978600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:37.979010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:38.188711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:38.197182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a1d80745-6b3f-425f-b04f-dfaf71f031d4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.240244 Sep 07 19:16:38.199602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 124/251] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:37 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:38.206353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:38.215267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:38.220231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:38.221431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dff52731-7049-4895-b0f4-9e2229d335fd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.267380 Sep 07 19:16:38.222005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 128/252] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:37 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:38.584098 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:38.584709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:38.592607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:38.593230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:38.593970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:38.594708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:38.595788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:38.596169 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:38.768789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:38.784763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fff7b8d7-cbb9-4c92-8cb1-50a774022cb9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.205075 Sep 07 19:16:38.784763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 125/253] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:38 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:39.226369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:39.227010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:39.234585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.235088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.239731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.239731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.239731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.239731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.249374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:39.250376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:39.258986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.260037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.260740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.262590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.263821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.264433 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.490949 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:39.493201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:39.499670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:39.501258 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:39.502741 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-01403edb-0e18-43f0-a5e8-19e8355c5627 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.258591 Sep 07 19:16:39.503274 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 126/254] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:39 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:39.504769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-84016e06-842f-4fb8-9f9c-1be3f7b7da50 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.281978 Sep 07 19:16:39.505502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 129/255] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:39 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:39.802606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:39.803889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:39.812799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.813621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.816531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.817260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:39.818933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:39.820264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:39.981761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:39.991305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-78f33399-4d39-4668-bc87-824c7c5ba534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.193493 Sep 07 19:16:39.992023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 127/256] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:39 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:40.530728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:40.531484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:40.536536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:40.536536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:40.538177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:40.538832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:40.539475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:40.540197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:40.540732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:40.541071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:40.541334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:40.541550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:40.541990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:40.542741 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:40.543205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:40.543639 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:40.549046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:40.758480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:40.759700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:40.772228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:40.773978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:40.774773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f57b819-497c-4f54-8e25-31d3e6470532 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.244828 Sep 07 19:16:40.775437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 128/257] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:40 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:40.775613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5e4e1116-7c79-4458-a18b-91fbca0b7c30 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.251251 Sep 07 19:16:40.785742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 130/258] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:40 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:41.017188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:41.017188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:41.022364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.022885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.023331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.024026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.024737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.025158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.203189 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:41.211870 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eb0c4de7-a0be-4fae-8790-6b4ec0d1acea tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.200818 Sep 07 19:16:41.213020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 129/259] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:41 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:41.802113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:41.804900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:41.805513 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:41.807462 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:41.809550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:41.812661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=66 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:41.817657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.818199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.818661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.819369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.819827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.820255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.825668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.826174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.826634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.827348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:41.827797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:41.828219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:41.843867 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:42.040096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:42.042722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:42.049489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:42.051186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:42.052697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3c2c2055-5593-453b-9bc1-c12bfba1ecf5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1743 microversion: 2.20 time: 0.255544 Sep 07 19:16:42.053321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1ea6f4b7-0295-488c-9948-a013cda189ab tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.256435 Sep 07 19:16:42.053571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 130/260] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:41 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1743 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:42.054112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 131/261] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:41 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:42.236448 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:42.237072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:42.246346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:42.249225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:42.249909 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:42.250702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:42.251225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:42.252633 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:42.466467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:42.477670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d080f45a-e1fe-4886-a905-078c99be8890 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1313 microversion: 2.1 time: 0.246055 Sep 07 19:16:42.478242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 131/262] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:42 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:43.076966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:43.078248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:43.080250 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:43.080892 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:43.086953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.091310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.091435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.091554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.091649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.091752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.091843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.091931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.092016 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.092105 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.092201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.092290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.305339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:43.309249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:43.318442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1ab78f95-9364-4b9f-b16c-d5c3ebc77ca1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.245122 Sep 07 19:16:43.318940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:43.322908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:43.325069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe6af6cc-7430-463a-a416-55a068ec182d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1743 microversion: 2.20 time: 0.250011 Sep 07 19:16:43.325713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 132/263] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:43 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:16:43.333197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 132/264] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:43 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:43.501178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:43.501844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:43.507938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.508429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.510429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.510429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:43.510429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:43.510429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:43.665507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:43.674323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c3a45c28-e690-4433-8db9-d3f0c8692e6b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1498 microversion: 2.1 time: 0.177000 Sep 07 19:16:43.675230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 133/265] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:43 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:44.343177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:44.349713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:44.349984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:44.350695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:44.351364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:44.352248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:44.352854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:44.353526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:44.354186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:44.354301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:44.361511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:44.361990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:44.362623 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:44.363555 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:44.365102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:44.365735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:44.628204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:44.636620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:44.638088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:44.639333 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-95ee6747-f980-425b-a0ea-6c3d7fc44a19 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1743 microversion: 2.20 time: 0.291171 Sep 07 19:16:44.646617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:44.655742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85c8dac4-e20f-4496-8bab-ef80c9e452d5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.316579 Sep 07 19:16:44.656325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 133/266] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:44 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:44.656794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 134/267] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:44 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1743 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:45.131733 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:45.132471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:45.139853 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.140550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.141135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.141988 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.142607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.143201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.173011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:16:45.549529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-277a07b6-8eb0-4aa6-8419-f314f33d8b2a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 204 len: 0 microversion: 2.1 time: 0.421125 Sep 07 19:16:45.550971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 135/268] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:16:45 2022] DELETE /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:16:45.559580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:45.560469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:45.567473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.568180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.568672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.570185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.570689 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.571124 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.671451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:45.672545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:45.679111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.679602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.680037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.680764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.681196 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.681624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.715356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:45.725958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ba3fb38e-50e6-4ba2-a48a-5e91888f7415 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1504 microversion: 2.1 time: 0.168440 Sep 07 19:16:45.725958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 134/269] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:45 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:45.731271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:45.731888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:45.737807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.738259 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.738744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.739446 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:45.739905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:45.740324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:45.860707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:45.869345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:45.870846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:45.872039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7cf8d15-0a61-48a2-a443-c4bf7d3b4e86 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1743 microversion: 2.20 time: 0.207319 Sep 07 19:16:45.872920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 136/270] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:45 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:45.908858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:45.916532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2d3b67cf-992d-4768-9883-62b0e7f422e6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.191039 Sep 07 19:16:45.917108 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 135/271] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:45 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:46.747777 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:46.748377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:46.754811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.755286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.756142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:46.756528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.756978 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.757397 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:46.899995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:46.901971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:46.905917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:46.909254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dac6a88f-4758-40c1-86d4-6979f9ac6121 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1504 microversion: 2.1 time: 0.166101 Sep 07 19:16:46.910287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 137/272] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:46 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:46.918167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.926502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.927223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:46.931734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.931734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.931734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:46.941655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:46.942402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:46.950673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.951171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.956164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:46.956164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:46.956164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:46.956164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:47.163089 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:47.172184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:47.173893 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:47.175721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-68e7602d-ba01-44aa-abf1-509342ad8b35 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.282034 Sep 07 19:16:47.176480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 136/273] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:46 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:47.181344 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "name": "network-vif-plugged", "status": "completed", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:47.187284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:47.191846 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:47.192729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:47.193360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:47.201212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77523f67-0c8e-4f0c-9dc8-202269b4fb1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.263963 Sep 07 19:16:47.201874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 138/274] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:46 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:47.208789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] Creating event network-vif-plugged:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:16:47.214431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-1dadc0a0-fb2a-4651-88e6-9bb4c212c22b req-094d771c-d42e-4b81-ae75-e3677e0fcef7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Sep 07 19:16:47.215332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 137/275] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:16:47.937628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:47.938239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:47.944617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:47.945094 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:47.945527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:47.946207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:47.946687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:47.947107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:48.075511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:48.083341 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-902c5a13-8b09-44b2-88af-b527099a7fb6 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1504 microversion: 2.1 time: 0.150189 Sep 07 19:16:48.083908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 139/276] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:47 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:48.202628 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:48.203251 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:48.209347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:48.209818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:48.210244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:48.210946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:48.211391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:48.211806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:48.227023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:48.227718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:48.234468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:48.235336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:48.235781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:48.236489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:48.236944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:48.237370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:48.403590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:48.407471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:48.412083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:48.413518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:48.414693 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-86dd04dd-4efe-4c31-9d05-b25ac7b64055 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.216359 Sep 07 19:16:48.415089 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cdfaca8d-50a3-452d-a4af-52577a98114b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.192024 Sep 07 19:16:48.415705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 138/277] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:48 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:48.416327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 140/278] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:48 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:49.106093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:49.106728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:49.112604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.113088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.113524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.114206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.114696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.115120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.243957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:49.252091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c70bba13-e71c-4c3f-b3ea-421411f61ea2 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1504 microversion: 2.1 time: 0.149827 Sep 07 19:16:49.252654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 139/279] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:49 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:49.439835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:49.440378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:49.440494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:49.440700 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:49.446452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.446744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.446967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.447087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.447377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.447512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.448052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.448199 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:49.448495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.448653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:49.448906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.449075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:49.588080 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:49.597142 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:49.598641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:49.599804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-01e096f5-24c5-4316-8ec8-3b327b2e28d7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.163459 Sep 07 19:16:49.600363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 140/280] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:49 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:49.725596 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:49.733727 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dde03aff-e02f-4953-ac75-caa652446711 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.297832 Sep 07 19:16:49.734282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 141/281] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:49 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:50.275312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:50.275913 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:50.282391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.282923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.283360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.285520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.285520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.285520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.412983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:50.420888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-743b9b28-5fb1-4b63-a10c-e2b103aa5fe8 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1504 microversion: 2.1 time: 0.149642 Sep 07 19:16:50.421674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 141/282] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:50 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:50.436494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0eddda-a69a-4412-85d4-31076491e1e5", "name": "network-vif-deleted", "tag": "62bc09b9-4a6a-4421-a958-04c0eebcdb3a"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:50.446813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.447421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.447709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.459031 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] Creating event network-vif-deleted:62bc09b9-4a6a-4421-a958-04c0eebcdb3a for instance ac0eddda-a69a-4412-85d4-31076491e1e5 on hv-cinder-84773 Sep 07 19:16:50.463917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-319bdacd-5e07-4839-9740-0e48ff5fe393 req-fa5906e5-ccb8-4aae-b2b6-d8517ea3fe2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031170 Sep 07 19:16:50.464482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 142/283] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:16:50.624550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:50.625151 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:50.631079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.631548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.631972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.632722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.633075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.633495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.758060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:50.758794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:50.760795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:50.765552 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.766320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.766780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.767675 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:50.768272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:50.768864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:50.779039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:50.781021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:50.782405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-53d7105a-7e67-4f9f-92fa-643b23f79d5a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.162293 Sep 07 19:16:50.783453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 142/284] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:50 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:50.900207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:50.903711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:50.908298 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e27c6c76-98f7-4036-a979-5eb723d1f571 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.154780 Sep 07 19:16:50.908861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 143/285] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:50 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:51.444365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:51.444971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:51.450905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.451385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.451823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.452509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.452959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.453379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.515664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:51.523248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab8ca138-0fa2-4e54-b3fd-7aa072647799 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1462 microversion: 2.1 time: 0.082795 Sep 07 19:16:51.523804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 143/286] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:51 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:51.809541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:51.810088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:51.817238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.817751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.818265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.818875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.819329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.819747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.931797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:51.932397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:51.938340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.938850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.939279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.939968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:51.940410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:51.940827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:51.953797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:51.961937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:51.966881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:51.966881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72c0587a-7d5e-418d-9c50-275625fcf32b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.159349 Sep 07 19:16:51.966881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 144/287] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:51 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:52.067918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:52.078205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-66095d6e-9677-4905-bd76-3e937d5dd2a7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.147767 Sep 07 19:16:52.078205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 144/288] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:51 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:52.547498 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:52.548102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:52.553989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:52.554460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:52.554934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:52.555611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:52.556062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:52.556480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:52.616205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:52.624443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c53336ca-1465-415c-9926-e1e9c93e718d tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1462 microversion: 2.1 time: 0.081585 Sep 07 19:16:52.625012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 145/289] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:52 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:52.991239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:52.991846 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:52.998246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:52.998884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:52.999324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.000012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:53.000468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:53.000894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.099417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:53.100316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:53.107674 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:53.108467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:53.109166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.109977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:53.110682 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:53.111212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.138639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:53.147078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:53.148600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:53.150019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-55141bdf-d7b7-4858-8d1d-bc9c3b6334ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.162734 Sep 07 19:16:53.150601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 145/290] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:52 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:53.239343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:53.246868 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2af9a4c-e6df-4adf-936a-d9c70511dc80 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.151489 Sep 07 19:16:53.247967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 146/291] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:53 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:53.647810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:53.648639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:53.656972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:53.657729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:53.657918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.658624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:53.659079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:53.659499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:53.744500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:53.754037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-300a078f-fe86-4585-b205-8b16afd7f534 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1298 microversion: 2.1 time: 0.110274 Sep 07 19:16:53.755342 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 146/292] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:53 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:54.177632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:54.178992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:54.192883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.193708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.194358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.195272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.195904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.196505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.316721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:54.316721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:54.316721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.316721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.317944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.317944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.317944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.317944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.618826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:54.630167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:54.633501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:54.636026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4d081297-25d8-4b2f-84a1-275a60b60b13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.462439 Sep 07 19:16:54.636805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 147/293] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:54 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:54.708531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:54.716792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-285556bb-6f96-4ea0-a3bb-f03c479b6cd4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.450666 Sep 07 19:16:54.717366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 147/294] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:54 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:54.778052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:54.780071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:54.788692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.789612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.790278 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.791730 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.792967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.794249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.837226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:54.837809 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:54.838582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:54.839245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lazy-loading 'fault' on Instance uuid ac0eddda-a69a-4412-85d4-31076491e1e5 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:16:54.895951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:54.917873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6de3f040-0aaf-4afb-9e48-054704a7783a tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 200 len: 1303 microversion: 2.1 time: 0.144397 Sep 07 19:16:54.918455 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 148/295] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:54 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:55.684187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:55.685764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:55.701518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.702443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.705337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.706391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.707155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.710806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.741248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:55.742610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:55.751697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.754611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.755275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.758833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.759833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.760353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.924226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:55.928172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:16:55.936549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:55.940191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:55.943426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-11e2b0ef-d3c7-4f18-8f13-012c5f21e46b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.281122 Sep 07 19:16:55.947847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 148/296] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:55 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:55.954465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:55.955630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: ac0eddda-a69a-4412-85d4-31076491e1e5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:55.963815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.968330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.968330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.968330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:55.968330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:55.968842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:55.985094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] HTTP exception thrown: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Request method failure captured: Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 HTTP/1.1 Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO4DjkUo3XBZ8vsSADXi1mdz-2IzcnNcrJKC6EBlvMilSGjeSVsFBph0ri0XpqUMYSgLokDvladBov2jZzA-F3InwM1zypRPbTGlpdgiX1FQnEbiuHZG-aIA7mxXNQamrHYrl3OopgmADNlhZyKmcMCsALjUwu2kAIexYXWXLlUq4lM Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 702737b15c8e484d8aba627563179edf Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesActionsTest-16916472 Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:16:55.989422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/702737b15c8e484d8aba627563179edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_702737b15c8e484d8aba627563179edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/702737b15c8e484d8aba627563179edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/702737b15c8e484d8aba627563179edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesActionsTest-16916472 Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 702737b15c8e484d8aba627563179edf Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesActionsTest-16916472 Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesActionsTest-16916472-project Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 54bff8714b5b4f0d96b8fbeda69e4e98 Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesActionsTest-16916472-project Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. Sep 07 19:16:55.990941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'ac0eddda-a69a-4412-85d4-31076491e1e5'} Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:16:55.991771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. Sep 07 19:16:55.993118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.000396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Returning 404 to user: Instance ac0eddda-a69a-4412-85d4-31076491e1e5 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:16:56.000396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b89a561a-f18a-416f-b270-8bc605a3285e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5" status: 404 len: 111 microversion: 2.1 time: 0.048916 Sep 07 19:16:56.000396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 149/297] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:55 2022] GET /compute/v2.1/servers/ac0eddda-a69a-4412-85d4-31076491e1e5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:16:56.026977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:56.036205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e868555d-11e6-480e-96cf-75795e3f64cb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1501 microversion: 2.1 time: 0.299223 Sep 07 19:16:56.036782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 149/298] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:55 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:56.067877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09ae62e0-043d-4eae-8a06-e7e51a9daaf8"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:56.071238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:56.092756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.093355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.093875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.094734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.095885 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.096569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.130837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] HTTP exception thrown: Cannot 'attach_volume' instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 while it is in vm_state rescued Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Request method failure captured: Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/os-volume_attachments HTTP/1.1 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 74 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2bSgW7NxNjsZMDzfspirglJy-FLJ60CpkCUJFORZBJJZcdp-bxaMIPWakmrU-8jZjCIQ71ztK8vvSSDzS-uJ3tksUT8QWTaPBpQV_qszxcehEDPQUsOR84-8yrN_HE1HHGRl9amoIAAvwhHGCl8cIAUMtp6MPX4Sh3CIUbLiAX0A8 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:16:56.133303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 847f6bef4e7b44f4b0adf1bda9dadb7e Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {"volumeAttachment": {"volumeId": "09ae62e0-043d-4eae-8a06-e7e51a9daaf8"}} Sep 07 19:16:56.134932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Cannot 'attach_volume' instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 while it is in vm_state rescued Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'server_id': 'ca91c2bd-b822-4ce2-82fa-605aea3fb036', 'body': {'volumeAttachment': {'volumeId': '09ae62e0-043d-4eae-8a06-e7e51a9daaf8'}}} Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:16:56.136555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 while it is in vm_state rescued Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:16:56.138025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 while it is in vm_state rescued Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Returning 409 to user: Cannot 'attach_volume' instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 while it is in vm_state rescued {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9415612e-de60-460e-aa93-75cb593f8021 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073339 Sep 07 19:16:56.139436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 150/299] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:16:56 2022] POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 19:16:56.151894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:56.152632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:56.162002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.162785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.163428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.164691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.165338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.165863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.165985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1896145689", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "networks": [{"uuid": "24a2b4d6-7c2b-4cf8-a4af-cfdccace73b9"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:16:56.239855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] validate_networks() for [('24a2b4d6-7c2b-4cf8-a4af-cfdccace73b9', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:16:56.416283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18d5d0db-0106-4334-8441-fdfc9cb82de5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/action" status: 202 len: 0 microversion: 2.1 time: 0.272057 Sep 07 19:16:56.416906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 150/300] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:16:56 2022] POST /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:16:56.425986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:56.427378 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:56.434761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.435764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.435902 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.436498 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.436946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.437360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.618737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:56.629125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cf2fc080-5661-4acb-aac5-55d599d9bbbf tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1509 microversion: 2.1 time: 0.207553 Sep 07 19:16:56.662063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 151/301] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:56 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:16:56.724616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:16:56.725112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:16:56.725553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:16:56.725959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:16:56.726369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:16:56.741010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.741497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.741928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.742757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:56.743216 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:56.743641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:56.761433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Getting quotas for project 702737b15c8e484d8aba627563179edf. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:16:56.765533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Getting quotas for user 54bff8714b5b4f0d96b8fbeda69e4e98 and project 702737b15c8e484d8aba627563179edf. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:16:56.790684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:16:56.790684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:16:56.953447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a81aeb9b-8b87-49f8-971e-79a529bef362 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791364 Sep 07 19:16:56.955355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 151/302] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:16:56.967883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e31f514-2f66-4a5e-a942-79a222393c46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:56.975759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e31f514-2f66-4a5e-a942-79a222393c46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:56.976347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:56.977202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:57.000211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:57.000211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:57.000580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:57.001287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:57.001937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:57.003100 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:57.058033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0e31f514-2f66-4a5e-a942-79a222393c46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:57.065029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e31f514-2f66-4a5e-a942-79a222393c46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1214 microversion: 2.1 time: 0.102194 Sep 07 19:16:57.067976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 152/303] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:56 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:57.183516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:57.195891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:57.197336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:57.198816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-08c41d4d-a7fb-4964-a4c2-cd1a9429280d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.227341 Sep 07 19:16:57.199600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 152/304] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:56 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:57.659219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:57.659750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:57.665674 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:57.668021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:57.668021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:57.668021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:57.668021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:57.668475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:57.799946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:57.808027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3eecee58-ee3f-4763-8a48-d52cbbb07c0c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1509 microversion: 2.1 time: 0.152689 Sep 07 19:16:57.808917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 153/305] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:57 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:58.089223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bb27dcf6-5de3-4957-a673-9475fff042e9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:58.090165 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bb27dcf6-5de3-4957-a673-9475fff042e9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:58.156154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bb27dcf6-5de3-4957-a673-9475fff042e9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:58.163948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bb27dcf6-5de3-4957-a673-9475fff042e9 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1214 microversion: 2.1 time: 0.079378 Sep 07 19:16:58.166003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 153/306] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:58 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:58.225678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:58.227219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:58.242896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:58.243460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:58.243961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:58.244961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:58.245489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:58.245977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:58.395649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:58.407078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:58.409174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:58.410452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0496b1c0-7c49-404c-a958-998f73261ce6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.190153 Sep 07 19:16:58.411141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 154/307] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:58 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:16:58.837108 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:58.838122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:58.845428 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:58.850735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:58.850735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:58.850735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:58.850735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:58.851609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:59.002319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:59.018214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7e002af6-04be-4425-b855-8df779567f9a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1509 microversion: 2.1 time: 0.188863 Sep 07 19:16:59.022148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 154/308] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:58 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:59.190581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:59.191558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:59.201346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:59.208163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:59.208984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:59.218171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:59.220701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:59.221210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:59.307368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:59.323200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b2f4b0b5-c09c-4d82-ba02-4566269f8a49 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1218 microversion: 2.1 time: 0.135819 Sep 07 19:16:59.323831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 155/309] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:16:59 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:16:59.439802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:16:59.441207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:16:59.454972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:59.456201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:59.456424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:59.457197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:16:59.457658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:16:59.458234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:16:59.690884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:59.704537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:59.704537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:16:59.704537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0f4981e9-88fe-4a7f-94da-7d12b911adb4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.267769 Sep 07 19:16:59.725009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 155/310] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:16:59 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:00.043492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:00.044789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:00.053879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.053879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.054514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.055227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.055745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.056227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.254120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:00.264892 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb59595f-914c-4b12-9bb6-f4271369fc6a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1509 microversion: 2.1 time: 0.225299 Sep 07 19:17:00.278573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 156/311] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:00 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:00.348557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:00.348854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:00.355660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.356944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.357622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.358323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.358806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.359232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.426963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:00.438441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0e8de51e-53c8-47bc-ba5f-58b1d1a9343e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1266 microversion: 2.1 time: 0.094580 Sep 07 19:17:00.439018 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 156/312] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:00 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:00.734634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:00.735885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:00.742513 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.743174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.746684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.746684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:00.746684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:00.746684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:00.909867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:00.918181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:00.919703 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:00.920961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a32e8808-8aad-4b6c-80b2-508750d1e828 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.192425 Sep 07 19:17:00.921692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 157/313] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:00 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:01.292065 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:01.292677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:01.298629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.299105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.299534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:01.300210 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.300656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.301077 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:01.466700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:01.467806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:01.479124 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.483820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.483820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:01.483820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.483820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.484332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:01.534446 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:01.550864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-271ca0ed-5ea0-4f4f-8a3a-d79e183c4332 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1509 microversion: 2.1 time: 0.261710 Sep 07 19:17:01.551645 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 157/314] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:01 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:01.592407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:01.601962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-66227704-eb0c-4b27-a3e6-4004a21ce136 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1266 microversion: 2.1 time: 0.140385 Sep 07 19:17:01.614893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 158/315] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:01 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:01.957320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:01.958058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:01.976162 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.977193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.977516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:01.978345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:01.978709 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:01.979316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:02.147164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:02.159510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:02.161239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:02.162723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-45c6478b-2e78-4f19-b557-04205a45551e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.217319 Sep 07 19:17:02.164147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 158/316] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:01 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:02.579742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:02.582875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:02.594051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:02.594615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:02.595209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:02.596112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:02.596746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:02.597498 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:02.625523 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:02.626754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:02.633694 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:02.638644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:02.639302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:02.640263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:02.643974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:02.644857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:02.756532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:02.769504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4750e28-e16e-4942-9f0b-ebfb98695a04 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1272 microversion: 2.1 time: 0.147898 Sep 07 19:17:02.770690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 159/317] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:02 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:02.858828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:02.867829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-07dec5f6-c293-4757-a913-823349b9f8bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1515 microversion: 2.1 time: 0.291970 Sep 07 19:17:02.869852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 159/318] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:02 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:03.194364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:03.195940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:03.209000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:03.211209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:03.212746 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:03.214874 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:03.215532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:03.218099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:03.562152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:03.570841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:03.572314 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:03.573464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-79ba1e1e-6502-4b36-a967-e8976b772d13 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.385700 Sep 07 19:17:03.574005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 160/319] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:03 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:03.800073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:03.801416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:03.811407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:03.813619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:03.814361 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:03.816546 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:03.817328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:03.819872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:03.827668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:04.035492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:04.044392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b1f5bce0-0644-4693-b05f-a10c94b8d124 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.249170 Sep 07 19:17:04.045084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 160/320] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:03 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:04.600906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:04.602630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:04.611640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:04.616992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:04.616992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:04.616992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:04.616992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:04.617314 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:04.835569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:04.845758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:04.847942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:04.856297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0d7436ff-fbec-4723-92b9-362219fd283c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.253680 Sep 07 19:17:04.857627 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 161/321] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:04 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:05.069659 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:05.074987 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:05.110857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:05.110857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:05.110857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:05.110857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:05.111922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:05.111922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:05.472880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:05.480265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1c4b2d9f-dfa3-4c58-b04c-34ac3ff34d1f tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.415635 Sep 07 19:17:05.480874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 161/322] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:05 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:05.901288 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2337be6c-9130-4042-b8fe-8781d516ed81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: .version_select at 0x7ff4da4623a0>, body: {"keypair": {"name": "tempest-keypair-1916582303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6CcrOcv5UHwSrPNd3JCawpN9eApHPovxHTvpcVhaLS15y6K9DDVfCHL6qpX5WmIBzNVeuqlZIphw6DuNZOV3s8HCNJegUFZ0ILpIS3gNtuIkFLr+ErfxULDG5c78vqeg=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:05.901761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:05.902292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:05.915904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:05.916545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2337be6c-9130-4042-b8fe-8781d516ed81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:17:05.919609 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:05.920531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:05.921535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:05.922206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:05.922319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2337be6c-9130-4042-b8fe-8781d516ed81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for user 847f6bef4e7b44f4b0adf1bda9dadb7e and project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:17:05.924615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:06.037945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2337be6c-9130-4042-b8fe-8781d516ed81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145322 Sep 07 19:17:06.039192 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 162/323] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:17:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:06.379001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:06.390524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:06.393861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:06.396139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-44ac6de3-a186-4710-a832-1dec2e2fed1c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.498991 Sep 07 19:17:06.402908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 162/324] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:05 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:06.453357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653e25e6-baa5-43e5-a6c1-4a43aafdffed", "tag": "25baee25-c85a-48f4-9dbd-a202763dafb4"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:06.469361 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:06.470038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:06.471393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:06.495730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] Creating event network-changed:25baee25-c85a-48f4-9dbd-a202763dafb4 for instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed on hv-cinder-84773 Sep 07 19:17:06.502267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:06.502917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:06.513789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:06.514430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:06.518617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:06.524656 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:06.525092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-6a90cb71-77c8-47a8-96d8-cc77e0b2efd1 req-4f0fb18d-921c-4929-8bf0-88aa39fe6d76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066435 Sep 07 19:17:06.525092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 163/325] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:06.525425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:06.525425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:06.900188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:06.912493 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7244947-6e08-4ac1-b9d4-18e16785d96e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.413908 Sep 07 19:17:06.930377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 163/326] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:06 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:07.434449 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:07.435181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:07.438682 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:07.442442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:07.442946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:07.443431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:07.444123 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:07.444572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:07.444984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:07.592294 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:07.600759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:07.602336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:07.603601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f74d38b4-45b0-4b48-acef-763a2b51338e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1738 microversion: 2.20 time: 0.173505 Sep 07 19:17:07.604158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 164/327] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:07 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:07.946068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:07.946742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:07.948660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:07.954304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:07.954966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:07.955918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:07.956645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:07.957110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:07.957549 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:08.123466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:08.131619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2ced8c32-3ba1-4b34-b694-0692448b37ba tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.195634 Sep 07 19:17:08.132234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 164/328] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:07 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:08.629904 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:08.630441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:08.637433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:08.641320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:08.641320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:08.641320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:08.641320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:08.641678 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:08.771623 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:08.780599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:08.782333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:08.783644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0339db80-a3e5-419a-9a6d-95f7c260caf4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.158141 Sep 07 19:17:08.784286 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 165/329] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:08 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:09.155834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:09.156468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:09.163036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.163631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.164059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.164742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.165187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.165600 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.302071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:09.310396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-797dcdf8-32ac-4220-acde-08c544316143 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.159295 Sep 07 19:17:09.310984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 165/330] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:09 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:09.326022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1233229929", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "130327f0-428b-45b4-96e8-f00208541c08"}], "security_groups": [{"name": "tempest-securitygroup--1197236109"}], "key_name": "tempest-keypair-1916582303", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:09.429270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] validate_networks() for [('130327f0-428b-45b4-96e8-f00208541c08', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:17:09.805585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:17:09.806117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:17:09.806494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:17:09.807186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:17:09.807602 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:17:09.809678 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:09.817188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.817671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.818106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.818874 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.819333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.819825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.820108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:09.820707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:09.828071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.828553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.831009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.831009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:09.831009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:09.831009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:09.836979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:17:09.841607 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Getting quotas for user 847f6bef4e7b44f4b0adf1bda9dadb7e and project f0ca8c7ab1e64a0bb02a4941fe7b8105. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:17:09.853236 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:17:09.855756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:17:09.961451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:09.970060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:09.971537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:09.972682 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8b07d176-1523-4a6c-876e-fe4d3ff95ed0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.156831 Sep 07 19:17:09.973238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 166/331] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:09 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:10.028305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5f963f4c-84a2-4566-9529-bb0a423d1a25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.707193 Sep 07 19:17:10.028957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 166/332] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:17:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:17:10.040110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-619619d6-14e2-4f8f-afa0-89352ce9ae00 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:10.040717 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-619619d6-14e2-4f8f-afa0-89352ce9ae00 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:10.098346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-619619d6-14e2-4f8f-afa0-89352ce9ae00 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:10.105681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-619619d6-14e2-4f8f-afa0-89352ce9ae00 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1246 microversion: 2.1 time: 0.069496 Sep 07 19:17:10.106239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 167/333] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:10 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:10.334972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:10.335580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:10.342096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:10.342596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:10.343037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:10.343718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:10.344167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:10.344584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:10.483551 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:10.495622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-676708b0-375f-479a-8b1a-5070ad9036ad tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.164420 Sep 07 19:17:10.496806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 167/334] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:10 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:10.999125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:10.999668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:11.006157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.006668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.007101 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.008690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.008690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.008690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.128479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:11.129158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:11.138395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.139215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.139948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.141083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.143465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.143868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.145953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:11.155488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:11.156944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:11.158096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cabf27e6-f45b-4ee9-b785-60ddde593a1b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.163242 Sep 07 19:17:11.158709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 168/335] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:10 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:11.210266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:11.218679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2ea6ffb-4148-42ab-bab7-99e9159a07fb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1250 microversion: 2.1 time: 0.094356 Sep 07 19:17:11.219240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 168/336] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:11 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:11.519315 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:11.519926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:11.526110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.526729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.527802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.528488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.528942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.529360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.658159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:11.666245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2aba1ade-806e-49a3-9c97-af3a35fd5858 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.150735 Sep 07 19:17:11.666852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 169/337] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:11 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:11.973129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "name": "network-vif-unplugged", "status": "completed", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:11.982854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:11.983281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:11.983709 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:11.995013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] Creating event network-vif-unplugged:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:17:11.999884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-cb9e5ef0-764e-4937-8f63-9cb829f61fd0 req-9b412d14-c244-498c-bcbe-40645fa3f0cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030492 Sep 07 19:17:12.000469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 169/338] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:12.184159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:12.184767 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:12.191157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.191638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.192071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.192974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.193706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.194433 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.241591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:12.242382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:12.248770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.249547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.250200 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.250934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.251556 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.251983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.344302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:12.353483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-edc6c337-a385-4680-802c-4bfb1b1f3ada tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1250 microversion: 2.1 time: 0.115999 Sep 07 19:17:12.367943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 170/339] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:12 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1250 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:12.376426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:12.384807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:12.386645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:12.387838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2bf64ccf-5c63-499c-b41d-2e3bb7f4ec7a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.207734 Sep 07 19:17:12.388391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 170/340] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:12 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:12.689246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:12.693105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:12.696249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.696837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.697325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.698067 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:12.698599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:12.699567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:12.702335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:12.833306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:12.841297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-076bfb4c-e4d9-4556-82ad-ef2f14b0fe3b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.155877 Sep 07 19:17:12.841860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 171/341] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:12 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:13.378800 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:13.379414 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:13.381761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:13.387560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.388064 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.388542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:13.389240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.389697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.390125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:13.413541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:13.414145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:13.420568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.421059 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.421496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:13.422198 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.422842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.423281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:13.453821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:13.461707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-197d0640-a42d-4e52-b82f-afe13aadca9d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1298 microversion: 2.1 time: 0.086810 Sep 07 19:17:13.462282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 171/342] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:13 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:13.561935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:13.570270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:13.571816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:13.572914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-be24394e-308a-464c-810e-88aa9fd78ef9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.163384 Sep 07 19:17:13.573765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 172/343] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:13 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:13.864994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:13.865873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:13.872658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.873225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.873750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:13.874519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:13.875003 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:13.875505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:14.012733 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:14.020881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b2254e58-e72c-4a0d-a939-d82776e118fa tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.160217 Sep 07 19:17:14.021686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 172/344] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:13 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:14.488527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:14.489144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:14.505829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:14.505829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:14.505829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:14.505829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:14.506231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:14.506231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:14.565084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:14.574591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6be544b4-990d-4ec4-a900-b61607605919 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1298 microversion: 2.1 time: 0.089304 Sep 07 19:17:14.575182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 173/345] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:14 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:14.597116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:14.597873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:14.604135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:14.604624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:14.605089 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:14.605785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:14.606239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:14.606692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:14.751989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:14.760591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:14.762785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:14.769287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26422807-a0ad-44b9-abac-678a63370b22 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1720 microversion: 2.20 time: 0.170780 Sep 07 19:17:14.769287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 173/346] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:14 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:15.055275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:15.055878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:15.061958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.062442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.062916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.063635 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.064044 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.064466 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.196126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:15.204435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7b6afa35-2361-431e-bb65-dae0d4f7d3e4 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.153042 Sep 07 19:17:15.204999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 174/347] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:15 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:15.596801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:15.597408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:15.603447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.603923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.604356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.605125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.605580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.606001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.667976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:15.675750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ef1ec87e-20aa-40be-a9c3-7d6132f8c06f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1306 microversion: 2.1 time: 0.082700 Sep 07 19:17:15.676394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 174/348] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:15 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1306 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:15.793673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:15.794455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:15.801417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.801914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.802377 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.803152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.803611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.804042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.942506 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:15.951154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:15.952598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:15.953774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-208d4da0-7d85-48d7-bc77-f385215ddc05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1723 microversion: 2.20 time: 0.164321 Sep 07 19:17:15.954334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 175/349] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:15 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:15.979644 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d209846-c220-43b2-b219-3f9b9c030870"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:15.982144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:15.988394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.988872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.989302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:15.989985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:15.990430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:15.990872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:16.228257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:16.228940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:16.235552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:16.236106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:16.236600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:16.237561 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:16.238081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:16.238845 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:16.373534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:16.382088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-90a06bb8-cc45-43ea-9fe5-74f7e3a83e88 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.157911 Sep 07 19:17:16.382690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 176/350] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:16 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:16.699371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:16.699981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:16.705979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:16.708572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:16.708572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:16.708572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:16.708572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:16.709054 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:16.774386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:16.782946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-161fbcd6-5c8d-4093-9010-801978053d1f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1306 microversion: 2.1 time: 0.087345 Sep 07 19:17:16.783591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 177/351] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:16 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:16.873390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:16.972269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fe4dcb46-6dcf-4d19-82d2-63361a47941e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.996793 Sep 07 19:17:16.974238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 175/352] 10.222.0.46 () {62 vars in 1364 bytes} [Wed Sep 7 19:17:15 2022] POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 188 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:17:17.114847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:17.115548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:17.122372 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.122986 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.123412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.124111 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.124613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.125508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.171355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 19:17:17.406084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:17.406734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:17.413553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.414035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.414468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.415193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.415652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.416120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.451371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da55095e-1a21-47b9-9e34-a8d2413d7ad9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/action" status: 202 len: 0 microversion: 2.20 time: 0.340266 Sep 07 19:17:17.452189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 178/353] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Sep 7 19:17:17 2022] POST /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:17:17.460303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:17.461052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:17.467897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.468979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.469424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.470141 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.470639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.471591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.630131 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:17.639330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-008f4cf3-09af-4be7-a16d-915a44b80de0 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.236917 Sep 07 19:17:17.650812 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 176/354] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:17 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:17.657280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:17.667884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:17.669522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:17.670938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-adb6305d-8f7a-4c36-a368-e9df3cbeec29 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1809 microversion: 2.20 time: 0.214591 Sep 07 19:17:17.671674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 179/355] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:17 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:17.807407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:17.808104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:17.814663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.815415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.816085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.817124 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:17.817911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:17.818646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:17.920270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:17.935103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c43808d6-d280-443b-a7f8-0f6808797eec tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1306 microversion: 2.1 time: 0.129771 Sep 07 19:17:17.938607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 177/356] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:17 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:18.223254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653e25e6-baa5-43e5-a6c1-4a43aafdffed", "name": "network-vif-plugged", "status": "completed", "tag": "25baee25-c85a-48f4-9dbd-a202763dafb4"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:18.237945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:18.239191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:18.240216 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:18.253918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] Creating event network-vif-plugged:25baee25-c85a-48f4-9dbd-a202763dafb4 for instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed on hv-cinder-84773 Sep 07 19:17:18.258933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-e8b48ae5-f67d-4c86-8e02-c35ed1af77ef req-d7cfd2d4-6751-43f9-92a6-5be0d75dc075 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039245 Sep 07 19:17:18.259831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 180/357] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:18.665308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:18.665925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:18.673449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:18.674197 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:18.675748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:18.676642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:18.677475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:18.678054 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:18.699027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:18.699843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:18.706367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:18.707109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:18.708706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:18.708706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:18.708949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:18.709462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:19.092008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:19.102171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db277bfa-229f-4bc8-bb88-4c5c95745e26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.440747 Sep 07 19:17:19.109508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:19.114089 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 178/358] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:18 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:19.119477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:19.121315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:19.121900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:19.123163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:19.124448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3ee29fb9-4270-4b1d-8c36-1e526d85fe1f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1749 microversion: 2.20 time: 0.431692 Sep 07 19:17:19.125442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 181/359] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:18 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1749 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:19.129583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:19.130248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:19.136942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:19.136942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:19.136942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:19.136942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:19.286707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:19.296615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7e07859-b6b7-425e-a2de-a863b6ed8d88 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.181328 Sep 07 19:17:19.297193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 179/360] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:19 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:19.882258 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:19.902809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:19.903512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=18 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:19.909481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:19.909850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:19.910306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:19.922595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] Creating event network-changed:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:17:19.927384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-63888fb5-4a51-4468-9450-0b57938db592 req-ed77a903-774d-47de-b00f-ac8e4618c397 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049818 Sep 07 19:17:19.927997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 182/361] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:20.137276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:20.137916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:20.140257 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:20.145041 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.145636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.146080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.146819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.147312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.147736 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.157310 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:20.158062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:20.164368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.171546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.171546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.171546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.171546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.172181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.587177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:20.595454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:20.606575 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:20.607897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4468a065-8eb3-4591-9e17-f59e847cab6e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1314 microversion: 2.1 time: 0.474433 Sep 07 19:17:20.608386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:20.609467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 180/362] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:20 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:20.615622 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:20.616329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:20.620064 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2fc7fbc5-d2ba-4f1a-9c14-d7fddb29a7e0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1749 microversion: 2.20 time: 0.468031 Sep 07 19:17:20.622234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 183/363] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:20 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1749 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:20.624226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.624713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.625149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.625844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:20.626294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:20.626750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:20.758004 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:20.766846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-24003f2e-c460-4620-9bc3-c42d56b327b4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.155756 Sep 07 19:17:20.767477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 181/364] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:20 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:21.631011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:21.631685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:21.638132 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.638627 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.639088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:21.639774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.640217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.640633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:21.647283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:21.648149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:21.654998 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.655551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.655976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:21.656698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.657140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.657555 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:21.845345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:21.851542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:21.853256 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-00050b90-a64f-43a6-8e3c-39ec5ffebf2e tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1498 microversion: 2.1 time: 0.226186 Sep 07 19:17:21.854000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 184/365] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:21 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1498 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:21.858908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:21.859580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:21.860336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:21.861845 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:21.863051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5469258b-52d6-4697-879b-1dee9cf8e6ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1751 microversion: 2.20 time: 0.219841 Sep 07 19:17:21.863606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 182/366] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:21 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:21.874757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.874757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.874757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:21.874757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:21.876159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:21.876159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:22.016363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:22.025554 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ed396978-5b10-4858-abaf-68bdcb2e945c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.170256 Sep 07 19:17:22.026139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 185/367] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:21 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:22.890184 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:22.890830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:22.897251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:22.897806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:22.900223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:22.900223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:22.900223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:22.900223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:23.050011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:23.050833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:23.057117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:23.058155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:23.058517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:23.058661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:23.059319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:23.059834 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:23.060272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:23.068502 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:23.070231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:23.077869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7d5e77ab-fd20-4b27-a5dc-dd4c12f7d867 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1751 microversion: 2.20 time: 0.186099 Sep 07 19:17:23.077869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 183/368] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:22 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:23.190685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:23.199022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f411f065-3aac-41da-bf45-c4b204546500 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.153789 Sep 07 19:17:23.199593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 186/369] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:23 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:24.098973 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:24.099694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:24.106934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:24.107429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:24.108329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:24.109044 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:24.109494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:24.109918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:24.222994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:24.223601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:24.231677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:24.232171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:24.232626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:24.234193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:24.234932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:24.235357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:24.248121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:24.258768 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:24.260562 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:24.261898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbf80e60-a30f-4e4a-b5bc-69ac461a6519 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1751 microversion: 2.20 time: 0.167177 Sep 07 19:17:24.262453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 184/370] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:24 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:24.375965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:24.386927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34021b48-a251-4afb-862e-4feda85cfec1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.165641 Sep 07 19:17:24.386927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 187/371] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:24 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:25.296865 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:25.297595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:25.304147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.305372 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.305372 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.305805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.306256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.306712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.407795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:25.408534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:25.414640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.415097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.415719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.416421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.422406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.422406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.422406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:25.561006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:25.572270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:25.574019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:25.575312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e46f1abc-ed48-4f15-8bde-be0a4d3697b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1751 microversion: 2.20 time: 0.289052 Sep 07 19:17:25.575860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 185/372] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:25 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1751 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:25.644060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:25.644550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:25.651532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.652019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.652473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.653246 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:25.653698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:25.654114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:25.669763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:25.677451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a62d1275-ef63-44f3-b00c-78e6c8c02c78 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.273485 Sep 07 19:17:25.678233 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 188/373] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:25 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:25.680508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:17:26.018695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f3b7d73-3f46-4c02-be4f-eb53db51430b tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "DELETE /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 204 len: 0 microversion: 2.1 time: 0.376992 Sep 07 19:17:26.020710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 186/374] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:17:25 2022] DELETE /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 19:17:26.030081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:26.030733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:26.037935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.041270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.041270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.041270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.041270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.041891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.193778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:26.204415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dfd02c1f-d0a6-40a8-a4dc-881cfce50484 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1504 microversion: 2.1 time: 0.179349 Sep 07 19:17:26.205243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 189/375] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:26 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:26.609029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:26.609875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:26.632015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.636167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.636627 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.637475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.637868 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.638424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.702002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:26.703320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:26.709980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.711207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.711830 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.712773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:26.713420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:26.714170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:26.846517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:26.859451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:26.861791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:26.863107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7c2bcb84-2982-4540-b55a-1b9a90bafdf0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.263899 Sep 07 19:17:26.875644 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 187/376] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:26 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:26.901503 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:26.910610 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e446bef0-b27d-49f0-af8d-2368054b1a81 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.213053 Sep 07 19:17:26.917124 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:26 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:27.234647 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:27.235595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:27.246394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.247207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.248279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:27.249207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.249951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.250599 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:27.457569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:27.468120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-daef96f4-1c50-4eaf-b4ca-9fe14974ca46 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1504 microversion: 2.1 time: 0.241271 Sep 07 19:17:27.469729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 188/378] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:27 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:27.889776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:27.890388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:27.896837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.897323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.898013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:27.898748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.899232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.899658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:27.936159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:27.936936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:27.947237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.951816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.951816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:27.951816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:27.951816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:27.952415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:28.131618 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:28.141168 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:28.143081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:28.144360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-212edc48-68d6-4aa4-b211-1cd46074d6be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.259223 Sep 07 19:17:28.145133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 191/379] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:27 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:28.247745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:28.262163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7292228-a3ec-4283-b8a1-5e7efff17ec4 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.330853 Sep 07 19:17:28.282637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 189/380] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:27 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:28.373224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "name": "network-vif-plugged", "status": "completed", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:28.395925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:28.398255 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:28.398797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:28.418422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] Creating event network-vif-plugged:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:17:28.425374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-812c026e-eb5f-41db-98aa-a1b0c5e8ba3f req-8121d755-abfe-4499-9ff6-eb551288b1fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056438 Sep 07 19:17:28.429951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 192/381] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:17:28.490619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:28.494108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:28.497616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:28.551751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:28.558808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:28.560123 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:28.566712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:28.567378 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:28.596616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:29.067835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:29.085306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-36d38224-fbf2-403b-98e5-544354484d30 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1504 microversion: 2.1 time: 0.598612 Sep 07 19:17:29.096152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:28 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:29.177151 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:29.180543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:29.195876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:29.198788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:29.201333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:29.203693 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:29.204271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:29.206278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:29.295074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:29.297009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:29.319537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:29.320006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:29.320448 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:29.321163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:29.321618 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:29.324466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:29.591140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:29.594017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:29.600242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1f2280d3-251b-4942-931b-0f70f5755322 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.310050 Sep 07 19:17:29.605380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:29.607325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:29.608698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e89c919b-e978-4161-bac7-b71fce2f2653 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.437585 Sep 07 19:17:29.615117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 191/383] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:29 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:29.628791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 193/384] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:29 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:29.660843 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653e25e6-baa5-43e5-a6c1-4a43aafdffed", "name": "network-vif-deleted", "tag": "25baee25-c85a-48f4-9dbd-a202763dafb4"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:29.672318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:29.673393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:29.674324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:29.689047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] Creating event network-vif-deleted:25baee25-c85a-48f4-9dbd-a202763dafb4 for instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed on hv-cinder-84773 Sep 07 19:17:29.694851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-a2c7f815-b5e8-4bb5-b601-36dac9b7a75b req-b9d22247-eb72-42c1-871f-b2f0cc952aa1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044731 Sep 07 19:17:29.695464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 192/385] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:30.111875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:30.112521 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:30.121031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.123248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.123772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.124568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.125107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.125639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.225410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:30.240818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-214afc7d-6f30-4bbe-83ce-c13827cbcb90 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1462 microversion: 2.1 time: 0.133650 Sep 07 19:17:30.241499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 194/386] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:30 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1462 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:30.627129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:30.628501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:30.640413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:30.641024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:30.648645 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.649130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.649564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.650563 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.651072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.651502 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.652395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.652858 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.653310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.654388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:30.654883 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:30.656757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:30.872218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:30.885778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-03c5ac30-7d1a-4e87-a985-4e9dc55243dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1372 microversion: 2.1 time: 0.262561 Sep 07 19:17:30.887297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 193/387] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:30 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:17:30.903542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:30.913285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:30.915212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:30.916283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0ea0a68e-b41c-4951-94e4-e22ee11bf4ab tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.279707 Sep 07 19:17:30.917517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 195/388] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:30 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:31.270148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:31.271132 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:31.280415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.281583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.284075 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.302008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.302008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.302008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.361915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.362415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.362881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.363337 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lazy-loading 'fault' on Instance uuid 653e25e6-baa5-43e5-a6c1-4a43aafdffed {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:17:31.423605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54bff8714b5b4f0d96b8fbeda69e4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702737b15c8e484d8aba627563179edf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:31.444784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-68e89dd0-0dd2-4105-9cac-fad37dd253d3 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 200 len: 1304 microversion: 2.1 time: 0.172878 Sep 07 19:17:31.444784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 194/389] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:31 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:31.916789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:31.916789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:31.924584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.926824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.933160 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.934643 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.935261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.935792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.948904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:31.950875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:31.961874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.963878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.964523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:31.966272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:31.967016 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:31.967651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:32.450382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:32.466108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:32.476093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:32.479066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d8ffdadf-c275-4aea-9721-3ee9e5758d21 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1565 microversion: 2.1 time: 0.570388 Sep 07 19:17:32.479066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 196/390] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:31 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1565 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:17:32.485374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:32.487937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0eda6702-c271-43aa-b7d1-23e74b62a250 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.544456 Sep 07 19:17:32.490794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 195/391] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:31 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:32.491288 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:32.492378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] [instance: 653e25e6-baa5-43e5-a6c1-4a43aafdffed] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:32.513407 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:32.514416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:32.515176 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:32.515928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:32.521610 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:32.527555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:32.530139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:32.531587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:32.540660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:32.544866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:32.546798 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:32.547900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:32.552135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:32.557135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:32.583417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] HTTP exception thrown: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Request method failure captured: Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed HTTP/1.1 Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO4DjkUo3XBZ8vsSADXi1mdz-2IzcnNcrJKC6EBlvMilSGjeSVsFBph0ri0XpqUMYSgLokDvladBov2jZzA-F3InwM1zypRPbTGlpdgiX1FQnEbiuHZG-aIA7mxXNQamrHYrl3OopgmADNlhZyKmcMCsALjUwu2kAIexYXWXLlUq4lM Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 702737b15c8e484d8aba627563179edf Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesActionsTest-16916472 Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:17:32.585927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/702737b15c8e484d8aba627563179edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_702737b15c8e484d8aba627563179edf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/702737b15c8e484d8aba627563179edf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/702737b15c8e484d8aba627563179edf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesActionsTest-16916472 Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 702737b15c8e484d8aba627563179edf Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesActionsTest-16916472 Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesActionsTest-16916472-project Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 54bff8714b5b4f0d96b8fbeda69e4e98 Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesActionsTest-16916472-project Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. Sep 07 19:17:32.587564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '653e25e6-baa5-43e5-a6c1-4a43aafdffed'} Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:17:32.588696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. Sep 07 19:17:32.589932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:17:32.598178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] Returning 404 to user: Instance 653e25e6-baa5-43e5-a6c1-4a43aafdffed could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:17:32.599510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-15471646-6c9b-4b5a-8a4a-6ffb625cbc26 tempest-VolumesActionsTest-16916472 tempest-VolumesActionsTest-16916472-project] 10.222.0.46 "GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed" status: 404 len: 111 microversion: 2.1 time: 0.119379 Sep 07 19:17:32.600624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 197/392] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:17:32 2022] GET /compute/v2.1/servers/653e25e6-baa5-43e5-a6c1-4a43aafdffed => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:17:32.683552 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-63cb3549-b71b-4672-8f46-1af60ab56325 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179773 Sep 07 19:17:32.684873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 196/393] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:17:32 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:33.521691 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:33.523553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:33.534776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:33.538332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:33.539366 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:33.540283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:33.540969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:33.541572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:34.794276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:34.818597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:34.818597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:34.819862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-93a5a9d8-3fa4-49f3-9881-9dea5eb57198 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 1.299777 Sep 07 19:17:34.820443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 198/394] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:33 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:35.858994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:35.862390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:35.893158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:35.894075 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:35.894886 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:35.895789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:35.896418 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:35.901487 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:35.910999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:35.926130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:35.938057 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:35.940776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:35.971038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] Creating event network-changed:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:17:35.978573 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-1413f2be-ac0a-4bb0-8b74-d5ceb244cf82 req-8b57a9a2-9170-47f4-a2eb-c007df185147 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071409 Sep 07 19:17:35.979224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 199/395] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:17:36.342495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:36.356037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:36.357968 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:36.359580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-18f7e86b-b5e5-44ba-927b-f7973cca7f8e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.510102 Sep 07 19:17:36.381512 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 197/396] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:35 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:37.388305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:37.389739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:37.401894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:37.404785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:37.407777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:37.408850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:37.409407 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:37.409884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:37.688010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:37.700495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:37.733928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:37.744371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-08a144c2-ba29-49b1-8be0-1759fe12823e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.362381 Sep 07 19:17:37.756759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 200/397] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:37 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:38.786790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:38.787677 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:38.813035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:38.813530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:38.813955 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:38.814779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:38.815317 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:38.815772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:39.637708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:39.678262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:39.680671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:39.685117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-417bf462-7c27-47c7-95b6-f2d984cfe30a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.901217 Sep 07 19:17:39.688650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 198/398] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:38 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:40.718482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:40.720047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:40.727422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:40.731567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:40.731567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:40.731567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:40.731567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:40.732239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:41.231139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:41.262378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:41.266800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:41.271945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cb4f7a02-de6d-40c0-9d2b-dba700ff2152 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.556281 Sep 07 19:17:41.284804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 201/399] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:40 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:42.301859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:42.302466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:42.322341 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:42.323172 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:42.323808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:42.324528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:42.324982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:42.325401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:42.629931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:42.647118 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:42.650568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:42.652032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-788c7d44-d152-47bb-9350-4d0d5f1b196a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.354727 Sep 07 19:17:42.653907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 199/400] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:42 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:43.703053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:43.703808 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:43.711994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:43.719749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:43.720496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:43.721102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:43.722648 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:43.723314 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:43.723933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:43.944507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:43.966099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:43.968464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:43.971493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-603a7529-d5d5-4872-9fa2-240864c82100 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.294098 Sep 07 19:17:43.991461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 202/401] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:43 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:45.009424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:45.015052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:45.019735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:45.023864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:45.026227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:45.026227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:45.026227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:45.026534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:45.033700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:45.233797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:45.246760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:45.248922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:45.251058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f5ddd388-8938-4f4f-9616-cd5daa86d866 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.247424 Sep 07 19:17:45.251792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 200/402] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:45 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:45.632965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5645a377-3ab6-49af-9ffe-6515aa20dadc tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Action: 'create', calling method: .version_select at 0x7ff4da63d040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-290973285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmUxjvRU6Ch9DVJv9s7fQwicz2YNOvXPwziq1rtTl4qd8IG+Fw78u+nmFJWu7hTaU6tcZ5IjxrEyn/+AQV01W9oL+9Gi7BmC0c06eM1p97qh0dC/j3mR7hgeig1dppsCg=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:45.651910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5645a377-3ab6-49af-9ffe-6515aa20dadc tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for project 7847d148d828478b8124c8d08c8c582f. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:17:45.656267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-5645a377-3ab6-49af-9ffe-6515aa20dadc tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for user f9db5f73350c460f99e4ab5cdbe6907a and project 7847d148d828478b8124c8d08c8c582f. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:17:45.748154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5645a377-3ab6-49af-9ffe-6515aa20dadc tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.299998 Sep 07 19:17:45.748732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 203/403] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:17:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:46.284991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:46.284991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:46.286883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:46.287386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:46.287831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:46.288553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:46.289004 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:46.289427 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:46.445279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:46.453759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:46.455696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:46.457575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d19fd4c6-ba7c-42fa-815c-034dc08a0fd7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.182315 Sep 07 19:17:46.459069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 201/404] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:46 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:47.484825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:47.485430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:47.491425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:47.491909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:47.492343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:47.493087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:47.493573 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:47.494011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:47.657571 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:47.678740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:47.680325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:47.682127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a00ff9cc-9475-4dc6-a92f-9e13f9ac65d9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.201374 Sep 07 19:17:47.683147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 204/405] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:47 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:48.710432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:48.711810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:48.718854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:48.719655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:48.720400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:48.721338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:48.721855 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:48.722489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:48.879532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:48.894080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:48.895939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:48.897601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1a9e2cfe-6cad-4f66-bb57-59a31edb49fa tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.191883 Sep 07 19:17:48.898314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 202/406] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:48 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:49.930594 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:49.931250 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:49.957161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:49.958533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:49.958533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:49.959336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:49.961229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:49.961664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:50.130977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:50.140771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:50.142233 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:50.143489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6ad8e398-f8a5-45a6-9c49-1d7da7007e6b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.220834 Sep 07 19:17:50.144071 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 205/407] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:49 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:51.169931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:51.171766 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:51.178483 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:51.179093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:51.179746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:51.181434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:51.182102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:51.182572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:51.339118 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:51.354693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:51.356245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:51.357400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1cb37dac-b0fc-48b2-ac0c-15603b84b58d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.191897 Sep 07 19:17:51.357955 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 203/408] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:51 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:52.383989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:52.385707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:52.392063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:52.392633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:52.393090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:52.393779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:52.394243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:52.394796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:52.535381 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:52.544345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:52.545854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:52.547058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e47bf951-770b-44de-bb77-9b6c751c262c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.167665 Sep 07 19:17:52.548082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 206/409] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:52 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:53.573471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:53.574206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:53.582008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:53.582854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:53.583480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:53.584407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:53.585027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:53.585624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:53.815209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:53.824441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:53.825861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:53.827047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e50c3740-acb6-4e7f-8790-d358d507231f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.257885 Sep 07 19:17:53.827602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 204/410] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:53 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:54.852951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:54.853589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:54.859989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:54.860468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:54.860906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:54.861602 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:54.862055 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:54.862485 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:55.012861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:55.015500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:55.025777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:55.039881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:55.039881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5e5bad6c-9fd1-4cc6-941d-d321e321430f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.182623 Sep 07 19:17:55.039881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 207/411] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:54 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:17:56.057046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:56.057672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:56.064447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:56.064937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:56.065392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:56.066106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:56.066617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:56.067136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:56.208413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:56.220099 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:56.222107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:56.223530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8171f58e-76a2-4097-9b6e-d132ebbaf48f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.170749 Sep 07 19:17:56.239045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 205/412] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:56 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:57.262839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:57.268778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:57.270810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:17:57.273598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:57.274714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:57.275580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:57.276598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:57.277047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:57.278068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:57.504918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:57.513565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:57.516072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:57.516072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f9e1646-0b6d-4791-851b-ddadaf0f7229 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.258862 Sep 07 19:17:57.516737 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 208/413] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:57 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:58.250489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "name": "network-vif-plugged", "status": "completed", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:17:58.261479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:58.261970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:58.262426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:58.276247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] Creating event network-vif-plugged:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:17:58.281510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1799b7f5-188d-4095-a961-53fa8afe3df8 req-292f5761-e9d8-4819-8227-663208b30ffd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035220 Sep 07 19:17:58.282286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 206/414] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:17:58.544706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:58.545363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:58.555243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:58.555980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:58.556459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:58.557140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:58.557571 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:58.557965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:58.749339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:58.764257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:58.767577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:17:58.770352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e6106ddf-d33c-41f1-8191-bb9f317f9e66 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.231315 Sep 07 19:17:58.770352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 209/415] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:58 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:17:59.802942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:17:59.804467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:17:59.812253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:59.812924 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:59.817826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:59.817826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:17:59.817826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:17:59.817826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:17:59.851905 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=93 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:00.112710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:00.126697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:00.129144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:00.129371 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3ddd21e9-8aaa-4be5-bc16-be0002ab3433 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.332262 Sep 07 19:18:00.142979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 207/416] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:17:59 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:01.175017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:01.176021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:01.201600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:01.203189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:01.203914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:01.205346 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:01.206035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:01.206713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:01.461809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:01.472396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:01.474617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:01.475555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-88a2c538-cf7d-4609-83f3-0ae057c5affb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.318064 Sep 07 19:18:01.477176 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 210/417] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:01 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:02.527466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:02.528755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:02.537592 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:02.538049 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:02.538571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:02.540263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:02.540814 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:02.541294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:02.727308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:02.739797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:02.742101 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:02.744904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dfeb9b24-eb57-462d-b7b3-5ea83e677a47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.223699 Sep 07 19:18:02.745642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 208/418] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:02 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:03.772548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:03.774738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:03.785241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:03.787376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:03.788102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:03.791410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:03.792933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:03.796215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:03.991338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:04.006048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:04.008056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:04.009320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e0c0f213-7eef-4038-84da-5b407775c09a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.241150 Sep 07 19:18:04.009981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 211/419] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:03 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:05.039718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:05.041285 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:05.056206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:05.058653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:05.059200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:05.062047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:05.062795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:05.064559 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:05.410029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:05.426657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:05.429470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:05.431085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5ff12260-2b7a-4253-9402-870f2e0b4aaf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.399130 Sep 07 19:18:05.432352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 209/420] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:05 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:06.458127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:06.458878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:06.472325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:06.473095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:06.473728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:06.474838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:06.479459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:06.480180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:06.869992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:06.901222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:06.904285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:06.935848 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-380f76d9-ae14-43dc-8082-43f94533fa85 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.481758 Sep 07 19:18:06.937730 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 212/421] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:06 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:07.964183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:07.964702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:07.973142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:07.976965 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:07.977351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:07.978320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:07.979771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:07.983027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:08.229275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:08.247228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:08.253401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:08.255615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a02b72e5-2dbc-429b-95a2-ad94e5ada9b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1807 microversion: 2.20 time: 0.296199 Sep 07 19:18:08.256815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 210/422] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:07 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:09.287125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:09.287858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:09.294312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:09.294913 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:09.295420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:09.296218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:09.296749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:09.297246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:09.506983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:09.517770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:09.519444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:09.520624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d81948b0-bce8-4e3a-bf71-6029e700e3a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1794 microversion: 2.20 time: 0.238426 Sep 07 19:18:09.521599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 213/423] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:09 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1794 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:18.542950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bfe2616-8f73-4901-8760-21b073c76e5c"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:18.552521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:18.552521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=21 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:18.552521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=23 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:18.554136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:18.554651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:18.555111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:18.555925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:18.556382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:18.556808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:19.430327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-827956ad-6ee5-4d71-b322-e538d2ba7b9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891767 Sep 07 19:18:19.431346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 211/424] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:18:18 2022] POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:20.042815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1251972932", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-290973285", "security_groups": [{"name": "tempest-secgroup-smoke-1301025987"}], "block_device_mapping_v2": [{"uuid": "6208c9ab-afe7-44a1-9373-6b2312f0f781", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7907def-f826-42d8-850a-2135619ed42f"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:20.067325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:20.068844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=37 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:20.176274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] validate_networks() for [('a7907def-f826-42d8-850a-2135619ed42f', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:18:20.612819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:18:20.613217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:18:20.613675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:18:20.614431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:18:20.615179 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:18:20.640042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:20.640724 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:20.641326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:20.642237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:20.642865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:20.643449 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:20.670222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:18:20.675120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for user f9db5f73350c460f99e4ab5cdbe6907a and project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:18:20.779403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:18:20.781722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6208c9ab-afe7-44a1-9373-6b2312f0f781',volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:18:21.333610 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2119b37e-9a79-48cb-a056-0f8ed36a63e5 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.295414 Sep 07 19:18:21.334285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 214/425] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:18:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:18:21.347145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-59b23839-a980-432c-808d-850fd2e530ba tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:21.347916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-59b23839-a980-432c-808d-850fd2e530ba tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:21.425634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-59b23839-a980-432c-808d-850fd2e530ba tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:21.433502 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-59b23839-a980-432c-808d-850fd2e530ba tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1094 microversion: 2.1 time: 0.090913 Sep 07 19:18:21.449020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 212/426] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:21 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:22.458235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-13ee28ef-3b03-49e4-97a2-dd297f63c4c0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:22.458911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-13ee28ef-3b03-49e4-97a2-dd297f63c4c0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:22.548742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-13ee28ef-3b03-49e4-97a2-dd297f63c4c0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:22.556778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-13ee28ef-3b03-49e4-97a2-dd297f63c4c0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1094 microversion: 2.1 time: 0.102337 Sep 07 19:18:22.558096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 215/427] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:22 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:23.582506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:23.583120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:23.599240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:23.599753 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:23.600198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:23.605103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:23.607234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:23.607678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:23.767008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:23.797453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f447a661-2128-4c09-85fa-61294026468f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1136 microversion: 2.1 time: 0.211483 Sep 07 19:18:23.797890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 213/428] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:23 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1136 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:24.822219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:24.823497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:24.833645 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:24.834167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:24.839100 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:24.839822 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:24.844028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:24.845252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:25.002611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:25.021790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9547467b-7b3f-4eb6-91ad-2193ff8b6e76 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1200 microversion: 2.1 time: 0.203799 Sep 07 19:18:25.024660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 216/429] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:24 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1200 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:26.047880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:26.048539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:26.061187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:26.061706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:26.062148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:26.062954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:26.063621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:26.064325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:26.348447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:26.356886 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-64b28666-6504-4994-bcb3-392e22abd904 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1278 microversion: 2.1 time: 0.312967 Sep 07 19:18:26.357783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 214/430] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:26 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:27.213063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9beb5e5-4d22-41df-8c6b-48336dccb119", "tag": "57514c4b-7d26-49f2-8d0e-4f100199e0ee"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:27.227338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:27.233273 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:27.233918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:27.252773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] Creating event network-changed:57514c4b-7d26-49f2-8d0e-4f100199e0ee for instance e9beb5e5-4d22-41df-8c6b-48336dccb119 on hv-cinder-84773 Sep 07 19:18:27.266046 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-17c5f74d-0a9e-4be7-bcba-a969e0afebde req-57d64042-91f6-476e-a0e4-3d86c5d52f2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057045 Sep 07 19:18:27.269474 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 217/431] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:27.384985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:27.385598 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:27.396040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:27.396784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:27.397233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:27.398774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:27.399411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:27.400092 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:27.947409 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:27.955367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-216ce536-3483-4fab-a051-8cb4eb5a1027 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1278 microversion: 2.1 time: 0.575629 Sep 07 19:18:27.955932 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 215/432] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:27 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1278 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:28.980406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:28.981881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:28.996798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:28.998579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:28.999019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:28.999744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:29.000202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:29.000626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:29.251515 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:29.265949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-634cc7ec-ff57-412c-bb41-402df5fed2d3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1278 microversion: 2.1 time: 0.290032 Sep 07 19:18:29.267611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 218/433] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:28 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:30.291051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:30.291603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:30.298221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:30.298742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:30.299256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:30.304518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:30.304518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:30.304518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:30.468046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:30.479505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-40fa7bc2-7884-4d97-98f7-effd18437a16 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1278 microversion: 2.1 time: 0.192472 Sep 07 19:18:30.494284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 216/434] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:30 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:30.661112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:30.664950 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:30.666686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:30.671579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:30.672070 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:30.672513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:30.673212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:30.673687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:30.674150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:30.702148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'flavor' on Instance uuid 3ad2f433-f9af-4cc9-be0a-46dcf22a831f {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:31.247720 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6a6e50a8-a590-4020-97a5-a055446a6c25 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/action" status: 200 len: 32 microversion: 2.1 time: 0.590841 Sep 07 19:18:31.249168 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 219/435] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:18:30 2022] POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/action => generated 32 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 19:18:31.270594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:31.274115 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:31.283891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:31.284427 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:31.284854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:31.285595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:31.286041 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:31.286515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:31.430240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:31.461397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4299e80-f5d0-4cb1-aa91-d2cad33fbe1a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'create', calling method: .version_select at 0x7ff4da63df70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-64573902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQ7H2O31mtApteAIAMufEO3nyV2ycpAGFbS0YMBQLGjMaVG0QgCpUlTF4ziAZhjcjpq+iY4ntbg/a6uWy5WulEbt0Dq1GJbeGmyLrE+/767Z8ZzkbPzJzYR/pm9M2oY+Q=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:31.478395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-e4299e80-f5d0-4cb1-aa91-d2cad33fbe1a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Getting quotas for project 7e249e6872c846beaefe3f9b760b6319. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:18:31.482496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-e4299e80-f5d0-4cb1-aa91-d2cad33fbe1a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Getting quotas for user ddd54dd8bc3b41f3b649c2a26e5b54fe and project 7e249e6872c846beaefe3f9b760b6319. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:18:31.516696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:31.526952 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d5ebcf52-4fb0-41ef-9282-1e699afca816 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.270273 Sep 07 19:18:31.527727 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 217/436] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:31 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:31.532606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:31.533332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:31.541375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:31.541375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:31.541783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:31.542769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:31.543420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:31.544050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:31.600525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4299e80-f5d0-4cb1-aa91-d2cad33fbe1a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.145701 Sep 07 19:18:31.601042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 220/437] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:18:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:18:31.729979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1206351997", "imageRef": "7ccd0374-9146-43d4-bfb0-d9bcb2184e6e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-64573902", "networks": [{"uuid": "fdb882a0-322c-4b73-a1e4-3a8b66caee15"}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:31.799663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] validate_networks() for [('fdb882a0-322c-4b73-a1e4-3a8b66caee15', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:18:31.829418 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:31.839813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2ac393ed-e7cc-4e11-a2d7-91d04f222565 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1278 microversion: 2.1 time: 0.310398 Sep 07 19:18:31.846634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 218/438] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:31 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:32.279337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:18:32.279877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:18:32.280851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:18:32.281229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:18:32.281707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:18:32.291027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.291731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.292311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:32.293196 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.293654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.294082 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:32.311371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Getting quotas for project 7e249e6872c846beaefe3f9b760b6319. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:18:32.315487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Getting quotas for user ddd54dd8bc3b41f3b649c2a26e5b54fe and project 7e249e6872c846beaefe3f9b760b6319. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:18:32.327364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:18:32.329680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ccd0374-9146-43d4-bfb0-d9bcb2184e6e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:18:32.463854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0fe48338-3d80-4f60-83f9-e4d8cdcd7548 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737765 Sep 07 19:18:32.464552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 221/439] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 19:18:32.476135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-91bd687d-2e58-4841-82ff-20953cbf4e93 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:32.476746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-91bd687d-2e58-4841-82ff-20953cbf4e93 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:32.548851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-91bd687d-2e58-4841-82ff-20953cbf4e93 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:32.558907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:32.558907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:32.559111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-91bd687d-2e58-4841-82ff-20953cbf4e93 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1257 microversion: 2.1 time: 0.087019 Sep 07 19:18:32.559731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 219/440] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:32 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1257 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:32.563591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.564071 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.564603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:32.565424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.566815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.567316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:32.713499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:32.721799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ae034f29-ef75-431d-b1c2-ed70b3aecea3 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.171405 Sep 07 19:18:32.722365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 222/441] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:32 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:32.863018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:32.863639 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:32.869911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.870408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.870882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:32.871581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:32.872038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:32.872465 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:33.009434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:33.017269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9055c1ec-b3e9-420a-a968-33b4d46eddb1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.158113 Sep 07 19:18:33.017893 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 220/442] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:32 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:33.581308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6640733d-61c9-4893-a5cf-ad66b34444dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:33.582696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6640733d-61c9-4893-a5cf-ad66b34444dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:33.648430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6640733d-61c9-4893-a5cf-ad66b34444dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:33.655411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6640733d-61c9-4893-a5cf-ad66b34444dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1257 microversion: 2.1 time: 0.077994 Sep 07 19:18:33.655974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:33 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:33.746230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:33.747088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:33.753507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:33.753985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:33.754414 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:33.755120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:33.755673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:33.756040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:33.890494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:33.899813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a4ad066c-bb36-4fef-aa7c-b6620eff900b tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.158414 Sep 07 19:18:33.900369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 221/444] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:33 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:34.041550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:34.042079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:34.048187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.048811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.049254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:34.049947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.050404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.050872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:34.182237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:34.191771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0b99dd44-eff7-4971-b5a4-49473e1ba60f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.154706 Sep 07 19:18:34.192348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 224/445] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:34 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:34.679918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:34.680533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:34.686395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.686920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.687350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:34.688038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.688492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.688915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:34.732187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1037418394", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:34.753985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:34.762480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8e1c10e3-d0b8-4f1c-b34a-784bbbf3549d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1253 microversion: 2.1 time: 0.086910 Sep 07 19:18:34.763077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 222/446] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:34 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:34.786917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] validate_networks() for None {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:18:34.923836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:34.924377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:34.930909 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.931409 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.931845 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:34.932550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:34.933208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:34.933641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.345834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:35.355104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5ab3a1aa-eac9-46a5-aa9a-d820c291119e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.435218 Sep 07 19:18:35.355684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 223/447] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:34 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:35.360361 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:35.360962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:35.366891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.367569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.368159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.369011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.369613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.370192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.384122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:18:35.384949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:18:35.385593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:18:35.386218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:18:35.386851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:18:35.407312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.407846 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.408671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.409973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.410726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.411218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.435265 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Getting quotas for project ae71e430b86c435893eb2617d1fa5e33. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:18:35.439459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Getting quotas for user 300ae5cd8ead404c8d0b425e635b04b7 and project ae71e430b86c435893eb2617d1fa5e33. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:18:35.452579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:18:35.454891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:18:35.520022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:35.527460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dce93151-b5f0-4815-83a8-8a5bf7580050 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.170631 Sep 07 19:18:35.528017 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 224/448] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:35 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:35.702840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-de9e0c97-43a0-414c-86e9-2189bdda6a58 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.974549 Sep 07 19:18:35.703545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 225/449] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:18:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 19:18:35.715280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-90450bd9-a448-47b2-a47b-0d94a378afd8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:35.715890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-90450bd9-a448-47b2-a47b-0d94a378afd8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:35.773771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-90450bd9-a448-47b2-a47b-0d94a378afd8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:35.782209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-90450bd9-a448-47b2-a47b-0d94a378afd8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1215 microversion: 2.1 time: 0.070693 Sep 07 19:18:35.783082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 225/450] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:35 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:35.795596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:35.800663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:35.803875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.804359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.804796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.805489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:35.805948 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:35.806370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:35.869636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:35.877712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-84a60fc1-a98c-465c-8193-4056453c7c99 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1309 microversion: 2.1 time: 0.095753 Sep 07 19:18:35.878543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 226/451] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:35 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:36.379024 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:36.379638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:36.387334 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.388003 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.388605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.389504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.390058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.390695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.552140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:36.552799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:36.559380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.560762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.561271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.561993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.563045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.563583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.603565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:36.618393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-708d2d0a-a8bb-4623-b3ad-d7c69eb33a2a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.243520 Sep 07 19:18:36.629037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 226/452] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:36 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:36.806001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:36.806682 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:36.811161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:36.816982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.816982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.816982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.816982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.817329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.817329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.820939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ad07820f-bb95-459d-a303-be001ff334e2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.274012 Sep 07 19:18:36.821699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 227/453] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:36 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:36.887475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:36.895186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eeb9a410-00c4-483c-a5dd-bde0b74debee tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1219 microversion: 2.1 time: 0.093689 Sep 07 19:18:36.896163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 227/454] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:36 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:36.902097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:36.902796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:36.909019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.909497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.909922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:36.910849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:36.911205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:36.911652 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.111935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:37.122183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e1dd4f83-d067-416e-b396-5e6a2b7042aa tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.225166 Sep 07 19:18:37.140541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 228/455] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:36 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:37.649132 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:37.649758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:37.655838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.656322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.656762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.657461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.657915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.658340 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.800830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:37.811722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1c635977-0435-45bd-8045-a49dbb2517e2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.167189 Sep 07 19:18:37.812471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 228/456] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:37 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:37.844343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:37.844976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:37.851658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.852144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.852577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.853284 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.853726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.854146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.920465 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:37.921802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:37.928705 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.934750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.934750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.934750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:37.934750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:37.935267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:37.936954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:38.033577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:38.035767 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:38.043133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-719dba2c-e0d1-41c4-a505-052a33562be1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.202595 Sep 07 19:18:38.043755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 229/457] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:37 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:38.047646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-84595143-c3ac-47b9-bfde-32106a2157ab tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.130950 Sep 07 19:18:38.048317 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 229/458] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:37 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:38.151157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:38.151939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:38.158164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:38.158809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:38.159269 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:38.159972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:38.160420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:38.160839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:38.299539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:38.307862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-de4a69a5-08bb-4434-8a8f-f7aebcd267e4 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.161567 Sep 07 19:18:38.308428 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 230/459] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:38 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:38.836081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:38.836746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:38.843262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:38.844048 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:38.844601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:38.845351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:38.845856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:38.846330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:38.983475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:38.992531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-46603eba-81cb-4ae4-8ee9-200f623bcd75 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.160949 Sep 07 19:18:38.993342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 230/460] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:38 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:39.067488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:39.068146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:39.070565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:39.071636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:39.074852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.075343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.075784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.076494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.076949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.077190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.077371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.077671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.078103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.078828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.079286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.079709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.176482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:39.184750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cd8afab0-a8f8-4e49-a88d-c6acb543cc42 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.117891 Sep 07 19:18:39.185335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 231/461] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:39 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:39.250138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:39.257901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2a73c94c-5c71-4713-a637-e680467f1fe7 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.195711 Sep 07 19:18:39.258460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 231/462] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:39 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:39.331505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:39.349715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:39.349715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.349715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.349715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.350167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:39.350167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:39.350167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:39.475579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:39.483432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fc9001d5-4966-44a0-9594-80497b9b55dd tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.155788 Sep 07 19:18:39.483993 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 232/463] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:39 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:40.016530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:40.017256 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:40.024342 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.024921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.025360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.026072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.026525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.026973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.173591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:40.182261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-26ba1162-49b5-48d8-988d-334cac1b45a9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.169611 Sep 07 19:18:40.182870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 232/464] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:40 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:40.207935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:40.208550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:40.215402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.215898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.216335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.217052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.217509 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.217937 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.282017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:40.282524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:40.286087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:40.287581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:40.290432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.290949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.291386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.292280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.292790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.293230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.296697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4f9bbef4-2968-4530-9284-7497639995ca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.092561 Sep 07 19:18:40.298229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 233/465] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:40 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:40.461381 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:40.470035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2204c962-708c-439d-9574-f070a03f05c9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.192456 Sep 07 19:18:40.470632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 233/466] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:40 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:40.505276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:40.505896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:40.512513 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.513000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.513432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.514168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:40.514650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:40.515073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:40.655345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:40.663515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9788de29-affd-4b19-94bc-3f7696b341c8 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.162042 Sep 07 19:18:40.664279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 234/467] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:40 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:41.206297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.206930 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.213572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.214058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.214493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.215218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.215672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.216095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.220224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:41.324204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.333631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.348220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.348810 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.349314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.350093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.351255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.351947 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.355675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:41.364869 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f99af26e-a785-4a4e-ad7f-6c65b07d7f11 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.162314 Sep 07 19:18:41.375601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 234/468] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:41 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:41.431715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:41.439636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1b716681-bad8-4377-a808-f66259f7707e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.119234 Sep 07 19:18:41.440374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 235/469] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:41 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:41.494252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.494880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.501009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.501491 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.501922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.502650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.503101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.503519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.623913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.624903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.631006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.631496 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.632717 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.633424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.633882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.634303 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.645763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:41.654065 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e00d7cd1-f08e-4d7b-a2a0-d06856476d51 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.164683 Sep 07 19:18:41.659971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 235/470] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:41 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:41.674772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-73556efe-4780-422a-8b29-ec6748af98d4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments/0d209846-c220-43b2-b219-3f9b9c030870" status: 200 len: 194 microversion: 2.20 time: 0.055385 Sep 07 19:18:41.675458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 236/471] 10.222.0.46 () {60 vars in 1454 bytes} [Wed Sep 7 19:18:41 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments/0d209846-c220-43b2-b219-3f9b9c030870 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:18:41.687229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.687848 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.695118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.695608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.696047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.696752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.697203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.697673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.755519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:41.756330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:41.763338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.763904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.764469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.765234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:41.765725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:41.766184 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:41.854872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:41.863287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c2c254e7-cc31-46d4-937f-fe8556dcf8fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.179982 Sep 07 19:18:41.874938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 236/472] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:41 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:41.918785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'services' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:42.136077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-301b506c-2369-41de-ac62-78e4106949f1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments/0d209846-c220-43b2-b219-3f9b9c030870" status: 202 len: 0 microversion: 2.20 time: 0.387899 Sep 07 19:18:42.136656 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 237/473] 10.222.0.46 () {60 vars in 1457 bytes} [Wed Sep 7 19:18:41 2022] DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments/0d209846-c220-43b2-b219-3f9b9c030870 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:18:42.145154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:42.147795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:42.154032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.154524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.154996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.155699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.156155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.156581 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.187667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dba24411-0f2e-4a38-bb9f-f8eb736202a7 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046520 Sep 07 19:18:42.188237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 237/474] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:42 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:18:42.389097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:42.389791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:42.397988 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.398601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.399102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.399807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.400261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.400682 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.464891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:42.466492 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:42.472827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.473323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.473840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.474504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.474991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.475712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.558744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:42.566380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-018cfd8c-a6fb-4e55-9009-e7ade4c72e67 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.107028 Sep 07 19:18:42.567058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 238/475] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:42 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:42.581467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:42.590662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e11d558c-68e1-4da4-83ed-16eda89db069 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.206233 Sep 07 19:18:42.591447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 238/476] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:42 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:42.677761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:42.678292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:42.685183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.685615 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.686046 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.686775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.687220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.687636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.821852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:42.829876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dcf77c06-7996-4722-b79c-63caa831d16a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.156035 Sep 07 19:18:42.830675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 239/477] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:42 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:42.896862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:42.898320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:42.905630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.906211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.906755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:42.907518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:42.908065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:42.908547 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.061638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:43.070943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-094a41a1-1083-4a8c-a7e7-3aeae4758d2c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.186718 Sep 07 19:18:43.077030 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 239/478] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:42 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:43.200078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:43.202256 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:43.208434 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.208921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.209490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.210211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.210676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.211150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.243541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8096b8c1-d7ae-4d81-90f5-16d84aedd8a5 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047410 Sep 07 19:18:43.244191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 240/479] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:43 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:18:43.590294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:43.591045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:43.597614 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.598226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.598779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.599586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.600172 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.601977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.615160 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:43.616488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:43.624879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.625641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.626080 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.626969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.627563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.627998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.678405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:43.687489 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-396e3ae9-dec6-4b29-bf5f-5a753781d912 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.101201 Sep 07 19:18:43.688308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 240/480] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:43 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:43.788900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:43.797435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e16d106f-5d1a-45ae-86d5-5862e9d13f61 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.186556 Sep 07 19:18:43.798206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 241/481] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:43 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:43.853114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:43.853770 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:43.861340 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.867504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.867504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:43.867504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:43.867504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:43.867960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.004541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:44.012846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-17834a59-a7ed-44ee-bdb5-3f438152f81b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.164354 Sep 07 19:18:44.013611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 241/482] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:43 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:44.093323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:44.093936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:44.101235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.101726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.102166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.102903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.103407 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.103778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.245405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:44.255742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:44.259891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:44.261952 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29daf846-5c51-449f-9ec0-1cc146bf6d20 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.164710 Sep 07 19:18:44.262925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 242/483] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:44 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:44.266367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.266884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.273951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.273951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.273951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.273951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.310021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-326446cf-e3d3-4d3e-aa98-df30859c5629 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058349 Sep 07 19:18:44.351648 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 242/484] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:44 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:18:44.716020 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:44.737147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:44.737147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.737147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.737147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.737505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.737505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.737505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.822318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:44.822954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:44.832398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.832895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.833382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.834134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:44.834603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:44.835738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:44.847911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:44.857388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-86c3e350-1486-4e74-8883-36993190a051 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.149594 Sep 07 19:18:44.858710 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 243/485] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:44 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:45.018487 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:45.032655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b93989e3-a433-427a-9298-e6b817b7db4d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.214906 Sep 07 19:18:45.033850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 243/486] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:44 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:45.038790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:45.039722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:45.052653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.053240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.058422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.059282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.059743 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.061113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.235063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:45.245228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-287cf0f1-b5fa-4137-b97d-4bac3d3ebf4e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.211476 Sep 07 19:18:45.245952 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 244/487] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:45 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:45.286074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:45.290500 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:45.293542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.294035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.294462 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.295311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.295761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.296259 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.325406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:45.328182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:45.340139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.344486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.345088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.345967 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.346451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.346916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.392959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-62e1ab02-ccaa-492b-adc3-8f128fab8712 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073300 Sep 07 19:18:45.393944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 245/488] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:45 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 19:18:45.446081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:45.454677 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f4d6e462-6ff9-4f99-b594-8b4908f0aa6c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.172843 Sep 07 19:18:45.455632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 244/489] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:45 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:45.887268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:45.888557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:45.890399 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:45.891094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=26 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:45.895965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.896440 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.896863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.898319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:45.898809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:45.899226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:45.959225 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:45.967517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6405d0b1-11b8-4e50-956f-c32c8ded632d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.085797 Sep 07 19:18:45.968998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 246/490] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:45 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:46.057116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:46.057731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:46.059711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:46.064920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.065404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.065840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.066541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.067026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.072023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.072023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:46.196296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:46.204472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bc6120bd-e0b6-411a-bddd-dc6b2abf81b2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.151148 Sep 07 19:18:46.205028 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 245/491] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:46 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:46.268404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:46.269018 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:46.275809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.276285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.276720 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.277416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.277869 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.278295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.405941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:46.408224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:46.414127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.414631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.415068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.415763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.416245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.416672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.450653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-baed174c-3593-493e-9312-e6421493e280 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044432 Sep 07 19:18:46.450653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 246/492] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:46 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:18:46.478078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:46.478726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:46.484712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.485202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.485702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.486883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.486883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.487291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.505000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:46.513439 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a3e3e65c-2b00-4079-8b4c-9b4aaf0eeb35 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.248921 Sep 07 19:18:46.514235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 247/493] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:46 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:46.678026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:46.685811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8738757a-fa38-4db6-ab86-016c1875972c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.211485 Sep 07 19:18:46.689115 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 247/494] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:46 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:46.990814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:46.992029 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:46.998056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:46.998639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:46.999139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:46.999902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.000424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.000914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.060889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:47.068411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b2cf3ae4-4c08-41d9-9b1e-a6da8ff88c63 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1211 microversion: 2.1 time: 0.081562 Sep 07 19:18:47.068973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 248/495] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:46 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:47.126869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:47.138429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.138943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.139375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.151529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] Creating event network-changed:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:18:47.156703 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-355f9d84-b966-4384-8577-ada37d4fc8da req-57fd1977-6196-44bd-951f-d1a1aff2e2ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 Sep 07 19:18:47.157423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 248/496] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:47.228456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:47.229113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:47.235124 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.235599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.236079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.236771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.237214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.237645 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.423518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:47.431772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6fc43558-7b9a-4034-b562-cdac5d8e6f43 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.207441 Sep 07 19:18:47.432339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 249/497] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:47 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:47.459591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:47.462459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:47.468523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.468999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.469427 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.470109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.470568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.470991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.499831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b204d59f-35da-4d8f-8168-ec778a696e7b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044551 Sep 07 19:18:47.500296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 249/498] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:47 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:18:47.536942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:47.537547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:47.544416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.544896 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.545331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.546021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.546470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.546927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.672670 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:47.676234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:47.680998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cf222543-7998-4142-8b78-a3440e74c17a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.147905 Sep 07 19:18:47.681562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 250/499] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:47 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:47.708917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:47.709535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:47.716240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.716726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.717183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.717862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:47.718589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:47.718786 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:47.931768 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:47.940260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89bc19af-6e4f-4b10-bc6b-b5adba6f4d2b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.235262 Sep 07 19:18:47.943032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 250/500] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:47 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:48.091520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.092064 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:48.098506 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.099021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.099459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.100155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.100610 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.101036 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.185603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:48.193310 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bdf0ee2f-ed72-4443-8a5f-323a87b09ec7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1267 microversion: 2.1 time: 0.105643 Sep 07 19:18:48.198440 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 251/501] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:48 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:48.455270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.455989 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:48.463263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.463747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.464184 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.464882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.465509 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.465942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.514264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.516570 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:48.530272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.530921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.532642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.536008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.536890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.537468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.579878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-27637c63-60dd-4cd2-88a2-820350b05053 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070836 Sep 07 19:18:48.581339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 252/502] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:18:48 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:48.663343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.663842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:48.675902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.675902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.675902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.675902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.676320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.676320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.709124 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:18:48.788757 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:48.798659 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec9eaf37-28b0-45f1-aca9-2ae8fb647482 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.347301 Sep 07 19:18:48.815820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 251/503] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:48 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:48.823458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.824349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:48.827835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=89 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:48.832855 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.833358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.833797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.834509 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:48.835538 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:48.835990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:48.981757 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:48.989926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-904e72ea-334b-44ab-bf94-1b782c9ec52f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.172606 Sep 07 19:18:48.990805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 252/504] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:48 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:48.995536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:48.996153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:49.013188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.013689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.014128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.014878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.015336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.015766 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.101405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b59da061-d54e-440a-965f-943b9d7d26c9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 204 len: 0 microversion: 2.20 time: 0.441869 Sep 07 19:18:49.103510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 253/505] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Sep 7 19:18:48 2022] DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 19:18:49.113392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:49.114837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:49.125056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.125056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.125056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.125056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.125412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.125412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.150102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.157704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d440ecbb-b417-4712-be79-aaceb7461194 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.165688 Sep 07 19:18:49.158264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 253/506] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:48 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:49.222467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:49.223199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:49.231062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.231484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.231916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.232619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.233064 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.233478 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.254412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.262791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.264277 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.265462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0b2c8419-7562-44a5-bdf9-a18991bef3ad tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.157612 Sep 07 19:18:49.266023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 254/507] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:49 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:18:49.300117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.308260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d806fdd1-66fa-4028-9f85-eb8f373d685d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1285 microversion: 2.1 time: 0.092072 Sep 07 19:18:49.308826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 254/508] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:49 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:49.829200 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:49.829801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:49.838008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.838486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.838938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.839620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:49.840085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:49.840476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:49.983071 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:49.992824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-394333c8-8974-4364-b95d-1a4ce78273c7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.167289 Sep 07 19:18:49.994042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 255/509] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:49 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:50.014083 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:50.015355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:50.021492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.025651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.025651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.025651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.025651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.025987 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.170285 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.180867 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:50.181539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:50.186824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-64a4577c-66f0-4cf9-8d12-884aed57de01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.176266 Sep 07 19:18:50.187287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 255/510] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:50 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:50.188946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.189779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.190226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.190969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.191427 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.192175 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.296240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:50.298082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:50.309394 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.309950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.313084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.313084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.313084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.313084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.344436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.353197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-386613ec-7950-4f10-85cc-89454109ae55 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.176122 Sep 07 19:18:50.353775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 256/511] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:50 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:50.358677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9beb5e5-4d22-41df-8c6b-48336dccb119", "name": "network-vif-plugged", "status": "completed", "tag": "57514c4b-7d26-49f2-8d0e-4f100199e0ee"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:50.373221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.373777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.374278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.388879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] Creating event network-vif-plugged:57514c4b-7d26-49f2-8d0e-4f100199e0ee for instance e9beb5e5-4d22-41df-8c6b-48336dccb119 on hv-cinder-84773 Sep 07 19:18:50.393845 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fae58d08-9db6-4abe-a444-5ac000984f4c req-055dcec9-fbbf-48c4-b752-5346367aed27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038800 Sep 07 19:18:50.394525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 257/512] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:50.403951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:50.403951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:50.407728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.408369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.408805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.409510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:50.409962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:50.410386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:50.450917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.460605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.463153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.463603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1953294-4494-4254-a36f-569dcdc90a83 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.174237 Sep 07 19:18:50.466608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 256/513] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:50 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:50.499092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:50.507329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-452f3cc8-234e-4b22-943e-b1c474f17f06 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1273 microversion: 2.1 time: 0.111661 Sep 07 19:18:50.507897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 258/514] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:50 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:51.018112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:51.018839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:51.025998 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.026493 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.026979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.027691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.028149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.028581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.160277 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.169074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-33d14cd3-6f5e-411e-9c42-004b7964d91c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.154974 Sep 07 19:18:51.169662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 257/515] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:51 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:51.209423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:51.210062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:51.216081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.216564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.216995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.217690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.218140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.218584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.347708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.355855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cca89b89-9a79-40c7-adae-c0254b291083 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.150524 Sep 07 19:18:51.356415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 259/516] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:51 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:51.375877 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:51.376486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:51.382361 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.382866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.383300 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.383991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.384441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.384863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.489143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:51.489742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:51.495677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.496139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.496567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.497242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.497684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.498095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.514655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.522207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-248c3808-8c28-4847-acab-84a07c63007b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.150082 Sep 07 19:18:51.523620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 258/517] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:51 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:51.530590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:51.531407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:51.537139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.537624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.538093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.538812 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:51.539264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:51.539688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:51.681883 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.690463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.692539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.693728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f7b39f28-fbde-4c4b-b5d5-7ed8d36236fc tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.208473 Sep 07 19:18:51.694363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 260/518] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:51 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:18:51.712065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:51.719878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-beb83dd2-6f72-4707-8f89-13ed76a00cd4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.192815 Sep 07 19:18:51.720442 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 259/519] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:51 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:52.197019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:52.197871 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:52.212012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.212625 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.212947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.213887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.214532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.215184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.377103 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:52.377710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:52.384879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.385424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.386106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.387066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.387581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.388068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.767263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:52.775720 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31fbf629-df9e-403e-a8aa-4fdc93f27ff9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.584882 Sep 07 19:18:52.776288 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 261/520] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:52 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:52.795923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "name": "network-vif-plugged", "status": "completed", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:52.805797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.806276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.806731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.818069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] Creating event network-vif-plugged:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:18:52.823836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-30064b81-6579-44a3-922d-1a09b923a064 req-45d04a4d-63a5-4903-9e31-1792fcffe5f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Sep 07 19:18:52.824424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 262/521] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:52.829209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f08532-ddcf-40e9-8091-2163d844a0a4", "tag": "8361aede-2b0a-4fc0-a1c7-dfe985f08539"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:52.838340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.838881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.839305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.846692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:52.849728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] Creating event network-changed:8361aede-2b0a-4fc0-a1c7-dfe985f08539 for instance b4f08532-ddcf-40e9-8091-2163d844a0a4 on hv-cinder-84773 Sep 07 19:18:52.854671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-06148940-2a2e-4b4e-86ef-b61c8adbcd9e req-1fcd5209-ac15-478c-83ea-88fad625d028 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028979 Sep 07 19:18:52.855432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 263/522] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:52.855568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77afa349-79e1-40a7-a89b-649b928febc2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.481817 Sep 07 19:18:52.860218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:52.860893 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:52.866967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 260/523] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:52 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:52.867876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.868357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.869006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.869710 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.870161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.870612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.876398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:52.877251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:52.883846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.884342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.884782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:52.885490 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:52.885952 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:52.886672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.206815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:53.213051 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:53.222875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:53.228237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:53.233196 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-edbb8aee-1b73-411a-9bd5-24b62fbb344d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1722 microversion: 2.20 time: 0.363685 Sep 07 19:18:53.235934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-692c530b-69b1-435d-b7a3-72b6e62b615d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.377265 Sep 07 19:18:53.236739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 264/524] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:52 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:53.254664 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 261/525] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:52 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1722 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:53.265378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:53.266991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:53.280734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.283120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.283732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.284607 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.285613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.287463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.451451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:53.459167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-56a5e6cc-a2a0-49b0-ade9-e0a1194fa348 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.213032 Sep 07 19:18:53.460230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 265/526] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:53 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:53.803649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:53.804256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:53.810896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.811467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.811976 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.812758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.813443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.814089 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.834748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:53.859458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d755b0-e9a1-458b-816b-44554c028079", "name": "network-vif-deleted", "tag": "1a64815c-a4e8-4fac-80cc-0bf1067b6aaf"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:53.869403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.870169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.870843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.884616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] Creating event network-vif-deleted:1a64815c-a4e8-4fac-80cc-0bf1067b6aaf for instance 22d755b0-e9a1-458b-816b-44554c028079 on hv-cinder-84773 Sep 07 19:18:53.889936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-567fe2df-ba30-4c51-b9f9-dfd5e038450b req-a8261063-c450-4846-854d-33b12e93d7c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034382 Sep 07 19:18:53.890760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 266/527] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:18:53.899891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:53.901103 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:53.907512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.912435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.912435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.912435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:53.912435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:53.913000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:53.992866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.001377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-60fe43df-d215-411b-94f8-40f3c642cef9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.201625 Sep 07 19:18:54.002606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 262/528] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:53 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:54.098225 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.119627 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d07cc41e-6cc4-41c4-8881-691b62e7be59 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1266 microversion: 2.1 time: 0.227396 Sep 07 19:18:54.123622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 267/529] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:53 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:54.262022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:54.262708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:54.269177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.269671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.270108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.270836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.271291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.271716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.272234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:54.273237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:54.281023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.281762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.282324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.283242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.283758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.284330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.306183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:54.342109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.350126 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.351620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.352764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7780e944-5f4a-4743-8e02-e8d1a275c6c6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1366 microversion: 2.20 time: 0.094716 Sep 07 19:18:54.353828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 263/530] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:54 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:54.438315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.447631 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-250df4ec-3830-4507-88fe-35794ec91a59 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.182084 Sep 07 19:18:54.448223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 268/531] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:54 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:54.482689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:54.484428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:54.490880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.491940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.492373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.493075 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:54.493524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:54.493979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:54.629531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:54.638180 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-64713435-fcb6-44a5-9989-711aa99c9530 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.159362 Sep 07 19:18:54.638898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 264/532] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:54 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:55.026600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.027582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.034741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.035229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.035700 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.036399 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.036858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.037284 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.148913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.149506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.155691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.156178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.156606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.157299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.157749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.158173 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.177814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.186809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1d854634-f9f1-4076-bbac-17af13e56fe6 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1736 microversion: 2.1 time: 0.164588 Sep 07 19:18:55.187552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 269/533] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:55.300731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.308402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8d4f5780-10a8-4d16-86eb-41b7ecfd4afe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1453 microversion: 2.1 time: 0.163765 Sep 07 19:18:55.308967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 265/534] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:55.331299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.331934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.338404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.338897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.339320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.339999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.340440 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.340854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.376993 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.377594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.386703 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.387193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.387673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.388376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.388846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.389497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.421212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.421704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.422173 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.422720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'fault' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:55.478248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.489189 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.490589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.492138 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4aa6bedf-c9a6-4064-8aa8-3f05319908ac tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1371 microversion: 2.20 time: 0.118855 Sep 07 19:18:55.498657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 266/535] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:18:55.498657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.498657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.502420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.504875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.505266 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.505706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.506434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.507991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.507991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.512850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-10e25156-9ff9-4e7c-a6dc-86cb4601611d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1453 microversion: 2.1 time: 0.185219 Sep 07 19:18:55.513614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 270/536] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:55.658094 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.661698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:55.662687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:55.667599 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a669ce24-487f-471b-8d47-d57b6af3019b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1357 microversion: 2.1 time: 0.173829 Sep 07 19:18:55.670541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.670814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.670966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 267/537] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:55.671537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.672648 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:55.673283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:55.673950 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:55.813280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:55.828927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9b227ae-1e7c-4290-bb18-4707a20743f3 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.171365 Sep 07 19:18:55.829668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 271/538] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:55 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:56.212009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.212640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.219339 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.219828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.220303 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.221007 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.221461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.221890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.421745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:56.435711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-73b0edaf-4f6e-4272-b9aa-eb09fd47cdb9 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1716 microversion: 2.1 time: 0.228204 Sep 07 19:18:56.436681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 268/539] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:56 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1716 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:56.519978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.521741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.531539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.532259 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.532970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.533952 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.534621 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.535616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.558531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.559170 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.566097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.566604 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.567074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.567838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.568289 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.568735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.574010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.574740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.575329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.576083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'fault' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:56.623880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:56.632798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:56.634777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:56.636653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3f172f68-2049-43be-82e2-522b44c16594 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1371 microversion: 2.20 time: 0.122121 Sep 07 19:18:56.652006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 272/540] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:56 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:56.660977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f while it is in vm_state rescued Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Request method failure captured: Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments/7bfe2616-8f73-4901-8760-21b073c76e5c HTTP/1.1 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2bSgW7NxNjsZMDzfspirglJy-FLJ60CpkCUJFORZBJJZcdp-bxaMIPWakmrU-8jZjCIQ71ztK8vvSSDzS-uJ3tksUT8QWTaPBpQV_qszxcehEDPQUsOR84-8yrN_HE1HHGRl9amoIAAvwhHGCl8cIAUMtp6MPX4Sh3CIUbLiAX0A8 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:18:56.663693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 847f6bef4e7b44f4b0adf1bda9dadb7e Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:18:56.665348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Cannot 'detach_volume' instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f while it is in vm_state rescued Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '3ad2f433-f9af-4cc9-be0a-46dcf22a831f', 'id': '7bfe2616-8f73-4901-8760-21b073c76e5c'} Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:18:56.668152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f while it is in vm_state rescued Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f while it is in vm_state rescued Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:18:56.669646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Returning 409 to user: Cannot 'detach_volume' instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f while it is in vm_state rescued {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:18:56.670783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3921f63d-0f66-4e47-a371-120336703ba7 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments/7bfe2616-8f73-4901-8760-21b073c76e5c" status: 409 len: 152 microversion: 2.1 time: 0.111072 Sep 07 19:18:56.670783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 269/541] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:18:56 2022] DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments/7bfe2616-8f73-4901-8760-21b073c76e5c => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 19:18:56.675712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:56.676338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.682295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.682895 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.683397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.684152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.684755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.685343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.690605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.691314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.697916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.698486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.699050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.699818 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.700702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.700848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.837017 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:56.845302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-71c18ee2-0e08-4d3b-b32f-b365a12f4886 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1548 microversion: 2.1 time: 0.158891 Sep 07 19:18:56.845967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 270/542] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:56 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:56.851960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.852687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.859240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.859999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.860506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.861321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.861880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.862407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.922250 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ab00b4fb-6fd1-4a9a-a518-012237f6a484 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/action" status: 202 len: 0 microversion: 2.1 time: 0.250224 Sep 07 19:18:56.923384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 273/543] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:18:56 2022] POST /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:18:56.928827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:56.929613 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:56.936022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.936815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.937461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:56.938318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:56.938970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:56.939384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.041093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.050088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85093be9-dd73-484d-9b1d-38b580148b38 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.200408 Sep 07 19:18:57.050088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 271/544] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:56 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:57.057494 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:57.058171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:57.064095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.064751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.065247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.066012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.066533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.066985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.100442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.108769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-97d21ca7-2cf1-44b2-b9af-0a2c3e2243b9 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1548 microversion: 2.1 time: 0.183915 Sep 07 19:18:57.109560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 274/545] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:56 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:57.131348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:57.136963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.137752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Searching by: {'deleted': False, 'project_id': '7e249e6872c846beaefe3f9b760b6319'} {{(pid=121080) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 19:18:57.144645 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.145126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.145559 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.147673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.147673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.147673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.208254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.220479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8cbf66ae-9ffa-44a3-b1f2-f8090715914f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1724 microversion: 2.1 time: 0.170247 Sep 07 19:18:57.222375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 272/546] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:57 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:57.242760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.multi_cell_list [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121080) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 19:18:57.342022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5f4fb798-b075-43aa-8bae-b73917c2e3b2 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214366 Sep 07 19:18:57.342945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 275/547] 10.222.0.46 () {58 vars in 1125 bytes} [Wed Sep 7 19:18:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:57.355076 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:57.356115 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:57.363033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.363850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.364501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.365486 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.366185 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.366913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.584225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.593621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b5c3afb0-bab6-42af-b5a4-4c98a6f188d7 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1548 microversion: 2.1 time: 0.242921 Sep 07 19:18:57.594122 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 273/548] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:57 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1548 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:57.662186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:57.663525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:57.670040 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.670812 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.671311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.672073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.672591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.673075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.705142 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.705850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.706708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.707340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'fault' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:57.752083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.760801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.762243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:57.763424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-434c8664-c47e-44b8-a419-ce21edcbc4a6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1371 microversion: 2.20 time: 0.105056 Sep 07 19:18:57.763966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 276/549] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:57 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:57.938941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9beb5e5-4d22-41df-8c6b-48336dccb119", "tag": "57514c4b-7d26-49f2-8d0e-4f100199e0ee"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:57.950411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:57.951282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:57.951917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:57.964360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] Creating event network-changed:57514c4b-7d26-49f2-8d0e-4f100199e0ee for instance e9beb5e5-4d22-41df-8c6b-48336dccb119 on hv-cinder-84773 Sep 07 19:18:57.972120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-58e51768-492d-46f1-a7a0-c1193caca4ba req-9a1a4e9d-557a-4966-93c8-0fb7e1b11ef6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040343 Sep 07 19:18:57.972353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 274/550] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:18:58.072260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:58.072919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:58.078750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.079230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.079659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.080497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.080958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.081374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.217714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:58.226076 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4fa95af4-0798-4552-93c4-5f5ddc2fb1d7 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.157741 Sep 07 19:18:58.226694 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 277/551] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:58 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:58.248107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:58.248837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:58.255081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.255750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.256364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.257774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.258218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.258862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.404213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:58.412955 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e60a63f2-9c60-4d6d-869d-03aeed986ba8 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1724 microversion: 2.1 time: 0.169497 Sep 07 19:18:58.413526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 275/552] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:58 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:58.788657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:58.789254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:58.792411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:18:58.795875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.796351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.796773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.797457 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.797901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.798312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.831698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:58.832170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:58.832595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:58.833036 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'fault' on Instance uuid 22d755b0-e9a1-458b-816b-44554c028079 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:18:58.876657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:58.884584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:58.886028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:58.887191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aa798e37-e326-41bc-812b-ab50f523224d tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 200 len: 1371 microversion: 2.20 time: 0.102433 Sep 07 19:18:58.887757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 278/553] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:58 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:18:59.249140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:59.249758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:59.256260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.256774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.257210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.257900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.258364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.258827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.436496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:59.437214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:59.443486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.443968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.444450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.447629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.447629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.447629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.449684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:59.459212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f9c063f5-4f3a-40db-88a1-ac6ea7239e05 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.213880 Sep 07 19:18:59.460526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 276/554] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:59 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:18:59.580490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:18:59.587890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84558d84-e0c2-452f-995d-b5ac97d6df7d"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:18:59.589221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0f275cdf-db1e-41e1-90b4-864c5805f493 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1724 microversion: 2.1 time: 0.157637 Sep 07 19:18:59.589783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 279/555] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:18:59 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:18:59.590294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:59.596234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.596735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.597150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.597839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.598292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.598743 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.913833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:18:59.914433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:18:59.920374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.920852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.921283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.921972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:18:59.922417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:18:59.922865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:18:59.935733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 HTTP/1.1 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:18:59.937341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:18:59.939073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '22d755b0-e9a1-458b-816b-44554c028079'} Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:18:59.939974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:18:59.941411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:18:59.942733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:18:59.942733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31792538-7c65-4a22-9e2a-5fae1a553695 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 404 len: 111 microversion: 2.20 time: 0.028946 Sep 07 19:18:59.942733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 280/556] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:18:59 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 19:18:59.947552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c3e2dac9-19f0-465c-ba61-480ad4ccba95 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '.version_select at 0x7ff4da342af0>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:00.039704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c3e2dac9-19f0-465c-ba61-480ad4ccba95 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-225129247" status: 204 len: 0 microversion: 2.20 time: 0.095939 Sep 07 19:19:00.040220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 281/557] 10.222.0.46 () {60 vars in 1259 bytes} [Wed Sep 7 19:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-225129247 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 19:19:00.483723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:00.484342 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:00.491500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:00.491983 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:00.492417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:00.493113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:00.493569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:00.493993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:00.998371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:01.006360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a2b9ef20-a5d5-4f55-b461-4239e6ac2e48 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.526590 Sep 07 19:19:01.007510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 282/558] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:00 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:01.012331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:01.012990 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:01.018847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:01.019331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:01.019765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:01.020509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:01.020954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:01.021380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:01.194976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:01.203234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9696c428-2aa3-48f8-90c2-1688f91ed41e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1730 microversion: 2.1 time: 0.194739 Sep 07 19:19:01.203804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 283/559] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:01 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:01.208238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ad9d63f-aef5-49af-b857-c4fa494a86d2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: .version_select at 0x7ff4da601430>, body: {"keypair": {"name": "tempest-keypair-1133866481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcM6TPgYYjfNvrc0jiP4pmgKQZWnO6VmqdS+tPJU4KvrUA52g7U6MeGKD3QfJ02/xb4bZ1yh43lZSSpSH2rkyzDgPzNzYrDMa8m+hHJvu3b7hOdXZyDRSAVuzgNqCdVsg=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:01.224203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2ad9d63f-aef5-49af-b857-c4fa494a86d2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:19:01.228813 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-2ad9d63f-aef5-49af-b857-c4fa494a86d2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for user 920bdd998f0c4b62b108afc799a43964 and project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:19:01.319637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ad9d63f-aef5-49af-b857-c4fa494a86d2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.114803 Sep 07 19:19:01.320244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 284/560] 10.222.0.46 () {62 vars in 1200 bytes} [Wed Sep 7 19:19:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 19:19:01.324877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:01.325376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:01.331881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:01.332270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:01.332700 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:01.333392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:01.333833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:01.334248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:01.353662 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:01.390950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4a6a46b7-c6f4-4841-aafe-082e7e020dd5 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.807268 Sep 07 19:19:01.397326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 277/561] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:18:59 2022] POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments => generated 194 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:19:01.419434 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b22042dd-6570-4bfa-82a1-bad75c9f37a2 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097936 Sep 07 19:19:01.420615 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 285/562] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:19:01 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:02.030778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:02.031491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:02.050426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:02.050946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:02.051570 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:02.052289 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:02.052749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:02.053174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:02.058358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:02.276339 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:02.284265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72062d3c-45d9-45a6-8d22-3f619ba5c5df tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.258261 Sep 07 19:19:02.285002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 278/563] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:02 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:02.576218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:02.591836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:02.592315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:02.592747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:02.610299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] Creating event network-changed:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:19:02.615770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-2c197e4b-c721-4946-aece-b885d1d23069 req-4e84ba6e-b57b-4962-ab22-1bc0d11e3644 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043946 Sep 07 19:19:02.616417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 286/564] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:03.313608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:03.314231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:03.322157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:03.322974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:03.323657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:03.324424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:03.325049 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:03.325485 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:03.469255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:03.482260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7c38690-2954-4aa7-b31a-e70fc60ba9a4 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.172390 Sep 07 19:19:03.483158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 279/565] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:03 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:03.951597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-447757203", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b43c0fa0-38b1-4590-b1ab-4ffbd8daf6a9"}], "security_groups": [{"name": "tempest-securitygroup--2111615280"}], "key_name": "tempest-keypair-1133866481", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:04.057718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] validate_networks() for [('b43c0fa0-38b1-4590-b1ab-4ffbd8daf6a9', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:19:04.219287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f08532-ddcf-40e9-8091-2163d844a0a4", "name": "network-vif-plugged", "status": "completed", "tag": "8361aede-2b0a-4fc0-a1c7-dfe985f08539"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:04.228945 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.229436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.229865 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.245503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] Creating event network-vif-plugged:8361aede-2b0a-4fc0-a1c7-dfe985f08539 for instance b4f08532-ddcf-40e9-8091-2163d844a0a4 on hv-cinder-84773 Sep 07 19:19:04.250804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b92c0e80-c3ce-43e4-9dce-3809db3f1a70 req-94b56cc2-aaf6-4acd-9b68-a234858ec682 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Sep 07 19:19:04.251407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 280/566] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:19:04.435472 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:19:04.435899 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:19:04.436552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:19:04.436959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:19:04.437367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:19:04.446802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.447286 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.447718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.448470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.448918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.449339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.466528 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:19:04.470542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Getting quotas for user 920bdd998f0c4b62b108afc799a43964 and project 8a7d9bc5395b4fa09a1024d20a980991. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:19:04.481419 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:19:04.483840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:19:04.506036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:04.507280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:04.513807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.514287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.514748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.515434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.515897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.516322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.634159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-34c37704-6d59-4699-862d-f7bc1d236a15 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.687513 Sep 07 19:19:04.635292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 287/567] 10.222.0.46 () {62 vars in 1188 bytes} [Wed Sep 7 19:19:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 19:19:04.640234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:04.658591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:04.659101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:04.659714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:04.671411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] Creating event network-changed:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:19:04.676271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-a4c877ba-b71b-4710-8e5f-c134b5aac05d req-09ebaadd-70d0-4e0a-9e4c-fffad6533c9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Sep 07 19:19:04.676860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 288/568] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:04.682687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:04.683464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:04.742912 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:04.757471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bd087de8-ff5c-4902-90ac-608708208ac8 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.254771 Sep 07 19:19:04.758616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 281/569] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:04 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:04.765684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:04.774203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:04.775999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:04.777590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8571838b-27b5-49be-a033-1d14d4ac39a3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1281 microversion: 2.20 time: 0.099351 Sep 07 19:19:04.778387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 289/570] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:04 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:05.781174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:05.781778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:05.788756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:05.789260 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:05.789694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:05.790369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:05.790831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:05.791255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:05.802454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:05.805090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:05.810543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:05.811186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:05.811726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:05.812576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:05.813255 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:05.813919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:05.892535 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:05.901411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:05.902956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:05.904275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7b68f599-bcba-49d0-adee-f89f3cb4999b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1277 microversion: 2.20 time: 0.105856 Sep 07 19:19:05.905167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 290/571] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:05 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:05.953859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:05.962467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9500dd11-dca9-4ba5-af63-79c52449f3f2 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1315 microversion: 2.1 time: 0.185179 Sep 07 19:19:05.963510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 282/572] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:05 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:06.929469 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:06.930582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:06.936563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:06.937035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:06.937552 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:06.938246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:06.938722 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:06.939145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:06.986653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:06.987878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:06.995381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:06.995938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:06.996443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:06.997212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:06.997740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:06.998232 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:07.009634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:07.018007 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:07.019494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:07.020609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-89bd0668-e2da-49d0-8461-ca5aef99cf47 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1333 microversion: 2.20 time: 0.095107 Sep 07 19:19:07.021170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 291/573] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:06 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:19:07.128833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:07.137087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e59513a1-a285-40fb-8865-e0ab83f72fca tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1465 microversion: 2.1 time: 0.154282 Sep 07 19:19:07.137650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 283/574] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:06 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:07.184382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:07.184874 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:07.190777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:07.191255 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:07.191717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:07.192401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:07.192851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:07.193270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:07.217675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:19:07.501724 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f272acda-0a58-4139-a6f5-58c30e6b628e tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 204 len: 0 microversion: 2.1 time: 0.321436 Sep 07 19:19:07.505762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 292/575] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:19:07 2022] DELETE /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:19:07.510573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:07.511195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:07.517171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:07.517654 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:07.518092 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:07.518882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:07.519338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:07.519762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:07.646732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:07.655043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e61a45da-52c8-4a8e-b32f-a9d0b4df4a71 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1471 microversion: 2.1 time: 0.148338 Sep 07 19:19:07.655606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 284/576] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:07 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:08.045997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:08.046636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:08.052543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:08.053023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:08.053455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:08.054139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:08.054615 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:08.055068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:08.116883 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:08.125551 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:08.127038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:08.128143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4523b2fd-9d2c-4e9f-bbbc-28b92ce1d420 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1341 microversion: 2.20 time: 0.086554 Sep 07 19:19:08.128711 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 293/577] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:08 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:08.677660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:08.678284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:08.684634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:08.685117 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:08.685545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:08.686230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:08.686713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:08.687136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:08.814123 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:08.822346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e81f471a-f0da-4d87-b7ab-b8d389978a57 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1471 microversion: 2.1 time: 0.148492 Sep 07 19:19:08.822970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 285/578] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:08 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:09.153662 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:09.154370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:09.160719 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:09.161280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:09.161717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:09.162415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:09.162902 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:09.163332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:09.223838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:09.231880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:09.233338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:09.234542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1b2a1c1c-3181-4718-9a76-2c30fde6a868 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1351 microversion: 2.20 time: 0.084851 Sep 07 19:19:09.235129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 294/579] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:09 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:09.845400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:09.846020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:09.853140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:09.853624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:09.854063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:09.854790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:09.855246 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:09.855666 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:09.999211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:10.007130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b7f46420-c054-40cb-bce0-d3ba02f09d50 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1471 microversion: 2.1 time: 0.165548 Sep 07 19:19:10.007789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 286/580] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:09 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:10.266477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:10.267139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:10.293718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:10.293718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:10.293718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:10.293718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:10.294380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:10.294380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:10.502423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:10.517424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:10.517424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:10.517424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac81ecef-19fa-48a7-a52d-8ebae971747a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.257845 Sep 07 19:19:10.517785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 295/581] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:10 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:10.682725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f08532-ddcf-40e9-8091-2163d844a0a4", "name": "network-vif-deleted", "tag": "8361aede-2b0a-4fc0-a1c7-dfe985f08539"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:10.697866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:10.698342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:10.698794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:10.715662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] Creating event network-vif-deleted:8361aede-2b0a-4fc0-a1c7-dfe985f08539 for instance b4f08532-ddcf-40e9-8091-2163d844a0a4 on hv-cinder-84773 Sep 07 19:19:10.721195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-c31714a8-a37a-410a-85c0-b651ad6d3b35 req-4b6c967a-e4fa-4a61-ab8b-6b3f8c2ad6c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042630 Sep 07 19:19:10.722048 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 287/582] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:11.032665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:11.033959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:11.040760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.045563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.045563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.045563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.045563 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.046008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.076785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.077300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.077739 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.078189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lazy-loading 'fault' on Instance uuid b4f08532-ddcf-40e9-8091-2163d844a0a4 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:19:11.131238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '300ae5cd8ead404c8d0b425e635b04b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae71e430b86c435893eb2617d1fa5e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:11.146694 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7f2f1e06-527f-40c2-ab2d-fe245ce1116d tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 200 len: 1305 microversion: 2.1 time: 0.114108 Sep 07 19:19:11.146694 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 296/583] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:11 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:11.160361 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:11.161057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:11.170178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.170699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.171133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.171815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.172263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.172677 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.259424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:11.269886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.270600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.271171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.284533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] Creating event network-changed:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:19:11.291487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-d0b92271-556d-4425-a010-fdf75cbf7f79 req-0d1158ca-2b7d-4a76-8cad-b7e777160898 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Sep 07 19:19:11.292626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 297/584] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:19:11.318511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:11.326895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7a83492-be44-4690-bab9-fa8926707b61 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1594 microversion: 2.1 time: 0.171605 Sep 07 19:19:11.327471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 288/585] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:11 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1594 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:11.541794 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:11.542560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:11.548759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.549243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.551480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.551480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:11.551480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:11.551480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:11.784642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:11.792996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:11.794796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:11.796019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8f858b42-3c3e-4f7e-8b54-5f9f3c1a9692 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.259237 Sep 07 19:19:11.796681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 298/586] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:11 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:12.164915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:12.165669 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] [instance: b4f08532-ddcf-40e9-8091-2163d844a0a4] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:12.172590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:12.173715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:12.174165 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:12.175272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:12.175393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:12.175795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:12.192985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] HTTP exception thrown: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Request method failure captured: Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 HTTP/1.1 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO6IERDqFFqCy84ll8Do5SgOVsXSgzHbVOT6XjJpjcQT08ust7GHi0ygEzirMm-mvV4oe-c04xYpBYtZW66oWR1lbfMfSNdCxxDVSwSWH5i367uooeyYnWIT4FEzMwl8uGInONaalUp4rhPRSICSuMTcHOoYXhYi0yequGbngJIRx3I Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: ae71e430b86c435893eb2617d1fa5e33 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesNegativeTest-1984919539 Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:19:12.194850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ae71e430b86c435893eb2617d1fa5e33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ae71e430b86c435893eb2617d1fa5e33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ae71e430b86c435893eb2617d1fa5e33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ae71e430b86c435893eb2617d1fa5e33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesNegativeTest-1984919539 Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: ae71e430b86c435893eb2617d1fa5e33 Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesNegativeTest-1984919539 Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesNegativeTest-1984919539-project Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 300ae5cd8ead404c8d0b425e635b04b7 Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesNegativeTest-1984919539-project Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. Sep 07 19:19:12.197065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'b4f08532-ddcf-40e9-8091-2163d844a0a4'} Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:19:12.197981 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. Sep 07 19:19:12.199441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:12.200771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] Returning 404 to user: Instance b4f08532-ddcf-40e9-8091-2163d844a0a4 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:19:12.200771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9c24a252-ed9e-4e90-976a-54cb68d6d438 tempest-VolumesNegativeTest-1984919539 tempest-VolumesNegativeTest-1984919539-project] 10.222.0.46 "GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4" status: 404 len: 111 microversion: 2.1 time: 0.036414 Sep 07 19:19:12.200771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 289/587] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:12 2022] GET /compute/v2.1/servers/b4f08532-ddcf-40e9-8091-2163d844a0a4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:19:12.821606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:12.822157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:12.835124 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:12.835606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:12.836578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:12.840212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:12.840212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:12.840212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:13.072923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:13.081531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:13.083237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:13.084381 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8158f4a-826a-4551-a0a0-89a7e432b258 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.267383 Sep 07 19:19:13.099122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 299/588] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:12 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:13.771264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:13.782057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:13.782586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:13.783193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:13.795277 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] Creating event network-changed:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:19:13.800208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-a437feaf-b41d-47d0-a76d-cc8a1e770c47 req-ebda41c1-0059-473a-aab6-d2b42d3134e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032616 Sep 07 19:19:13.800796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 290/589] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:14.109861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:14.110621 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:14.117424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:14.117907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:14.118335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:14.119274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:14.119882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:14.120460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:14.313754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:14.322953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:14.324703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:14.326138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-655372ae-3760-4ec2-949c-47d22399115a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.220428 Sep 07 19:19:14.327202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 300/590] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:14 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:15.355431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:15.356136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:15.362182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:15.366084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:15.366084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:15.366084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:15.366084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:15.366412 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:15.517042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:15.528313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:15.530163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:15.531789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8daa0d35-fcac-49ec-8d77-c9ced2e35665 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.180962 Sep 07 19:19:15.532505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 291/591] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:15 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:16.563451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:16.564057 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:16.565978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=4 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:16.566705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=12 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:16.572260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:16.572795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:16.573301 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:16.573932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:16.574383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:16.574828 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:16.714750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:16.723086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:16.724602 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:16.725804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-23488fb6-3004-45d4-be46-57644fcbebfb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.166167 Sep 07 19:19:16.726467 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 301/592] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:16 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:16.853193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-196760056"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:16.853726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:16.861136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:16.861643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:16.862093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:16.863002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:16.863488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:16.863942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:16.996553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.network.security_group_api [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Adding security group 4b137f32-d7c5-42da-a35c-ed4ba0d6ce27 to port 65247852-26e5-4da8-826a-69179f8419cb Sep 07 19:19:17.376079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-61c273e3-9366-4cda-a3e7-2aa38f9b9845 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action" status: 202 len: 0 microversion: 2.1 time: 0.527310 Sep 07 19:19:17.376695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 292/593] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:19:16 2022] POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:19:17.384327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:17.394882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:17.397274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:17.397396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:17.397494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:17.397583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:17.403668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:17.404155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:17.404590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:17.405294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:17.405747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:17.406270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:17.408824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] Creating event network-changed:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:19:17.414182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-f6ce9320-e1e3-4879-a1fb-292c54404328 req-0c98677a-e974-4446-b0a2-c2196344bce5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033469 Sep 07 19:19:17.415410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 302/594] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:17.552497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:17.560713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-758f1a53-4807-409d-b03d-553a1ce1b85b tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1759 microversion: 2.1 time: 0.168691 Sep 07 19:19:17.561999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 293/595] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:17 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:17.752592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:17.753151 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:17.759989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:17.760542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:17.761029 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:17.761728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:17.762174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:17.762681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:17.919513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:17.928723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:17.931420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:17.932644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-97cdf0ba-7f56-4967-ac2d-a06c41978469 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.185160 Sep 07 19:19:17.933512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 303/596] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:17 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:18.501829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "name": "network-vif-plugged", "status": "completed", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:18.518309 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:18.518309 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:18.518309 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:18.526929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] Creating event network-vif-plugged:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:19:18.531839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-6978a77f-56cf-47d8-aa0c-ae3fc931702b req-2ee3fade-c05c-4268-9373-39144da61df4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 Sep 07 19:19:18.532521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 294/597] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:18.966526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:18.966526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:18.970433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:18.970433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:18.970433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:18.970433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:18.971045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:18.971045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:19.113022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:19.116943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:19.122213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:19.123889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:19.125034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6f466d72-b1e4-4c28-a4f9-efed6af3f157 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.168935 Sep 07 19:19:19.125642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 304/598] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:18 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:20.153386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:20.154172 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:20.156762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=88 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:20.161602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:20.162080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:20.162508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:20.163222 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:20.163692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:20.164752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:20.299213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:20.307640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:20.309116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:20.310230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e67cb027-fd10-44af-9e8a-0448be5567e1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1407 microversion: 2.20 time: 0.163488 Sep 07 19:19:20.310854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 295/599] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:20 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:21.334543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:21.335176 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:21.341809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:21.342452 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:21.342977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:21.343709 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:21.344166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:21.344591 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:21.474218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:21.483474 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:21.485499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:21.486136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4aedadc-94b7-447f-acfc-69c242d9bf40 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1599 microversion: 2.20 time: 0.156076 Sep 07 19:19:21.486733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 305/600] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:19:21 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:19:21.510974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:21.511471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:21.517830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:21.518313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:21.518789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:21.519480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:21.519933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:21.520353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:21.595069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-99260b41-0442-46bc-92c7-031c9e352c37 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087986 Sep 07 19:19:21.595680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 296/601] 10.222.0.46 () {60 vars in 1316 bytes} [Wed Sep 7 19:19:21 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:19:22.554824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:22.564069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:22.564547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:22.564968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:22.575866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] Creating event network-changed:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:19:22.580909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-64c8b77e-eb7a-47f7-a12c-4692039df9f3 req-8585b0e2-718b-4038-84f5-7058c7094cdc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029815 Sep 07 19:19:22.581864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 306/602] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:40.198521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:40.199310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=88 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:40.200385 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 19:19:40.200535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Wed Sep 7 19:19:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action (ip 10.222.0.46) !!! Sep 07 19:19:40.204780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:40.207071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:40.215706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:40.216205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:40.218073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:40.218073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:40.218073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:40.218370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:40.470158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27dc0e20-3f2c-4973-97b8-81238723c6b6 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action" status: 202 len: 0 microversion: 2.1 time: 0.273093 Sep 07 19:19:40.470749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 297/603] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:19:40 2022] POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:19:40.479922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:40.480709 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:40.484065 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:40.484710 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=8 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:40.488497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:40.488989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:40.489437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:40.490145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:40.490654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:40.491085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:40.797705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:40.806374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea2db204-8ad9-4dcf-957e-5dc23bffd1fb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1751 microversion: 2.1 time: 0.330630 Sep 07 19:19:40.807485 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 307/604] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:40 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1751 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:41.831292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:41.831991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:41.838590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:41.839676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:41.840112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:41.840805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:41.841261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:41.841686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:42.038665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:42.047244 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-827a4854-d54a-49ef-bfcb-d8f26dbd3686 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.220209 Sep 07 19:19:42.047861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 298/605] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:41 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:43.071867 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:43.072581 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:43.079514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.079942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.080378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.081173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.081625 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.082051 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.228218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:43.236560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-31151ab0-4f6f-47de-8215-3ec6af33ef8f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.168721 Sep 07 19:19:43.237164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 308/606] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:43 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:43.476631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:43.477121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:43.483510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.483995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.484434 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.485128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.485581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.486008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.566972 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'services' on Instance uuid 3ad2f433-f9af-4cc9-be0a-46dcf22a831f {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:19:43.768349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7243b777-2550-48c7-bbfc-a73ae4c43af5 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments/7bfe2616-8f73-4901-8760-21b073c76e5c" status: 202 len: 0 microversion: 2.1 time: 0.295432 Sep 07 19:19:43.768939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 299/607] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:19:43 2022] DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments/7bfe2616-8f73-4901-8760-21b073c76e5c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:19:43.777953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:43.780300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:43.786430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.786957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.787394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.788094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:43.788549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:43.788975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:43.819729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-734bdfad-30c6-49ad-af52-92dddeb8e1bb tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Sep 07 19:19:43.820292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 309/608] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:19:43 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:44.260395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:44.261461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:44.269985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:44.270468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:44.270935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:44.271627 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:44.272081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:44.272530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:44.412470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:44.421258 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-296b6d23-3292-4113-a812-0fc3352a608e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.165075 Sep 07 19:19:44.421819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 300/609] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:44 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:44.832823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:44.835037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:44.841688 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:44.842174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:44.842644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:44.843338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:44.843793 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:44.844269 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:44.873883 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7ab5b4a4-0f58-4a4c-bc34-9673e97cba54 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Sep 07 19:19:44.874451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 310/610] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:19:44 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:45.444389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:45.444999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:45.451915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:45.452402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:45.452840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:45.453536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:45.453986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:45.454413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:45.596095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:45.604182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e133901e-4e57-44e8-9321-1d63e602c4c1 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.163632 Sep 07 19:19:45.604793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 301/611] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:45 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:45.885466 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:45.887665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:45.893649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:45.894134 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:45.894595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:45.895287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:45.895740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:45.896161 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:45.925415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9179901e-f1dd-436c-a598-a374a4e4d4ca tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043923 Sep 07 19:19:45.925961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 311/612] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:19:45 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:19:46.001789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:46.002288 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:46.008157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.008641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.009078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.009771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.010225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.010706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.035566 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:19:46.295690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-55bd5671-762a-4c89-8e4f-fca080459d47 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 204 len: 0 microversion: 2.1 time: 0.297542 Sep 07 19:19:46.296279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 302/613] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:19:45 2022] DELETE /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:19:46.304460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:46.305170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:46.311413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.311897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.312882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.313780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.314247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.314695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.443864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:46.452166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8b2367b8-c40f-4b9a-9f6e-8a9848a9fbee tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1690 microversion: 2.1 time: 0.151641 Sep 07 19:19:46.452740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 312/614] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:46 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:46.627921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:46.628624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:46.634958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.635436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.636468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.637153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:46.637605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:46.638025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:46.782193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:46.790368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5565ba84-56f1-4152-bd1a-3c0c63c5210f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.166678 Sep 07 19:19:46.790988 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 303/615] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:46 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:47.474656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:47.475291 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:47.481944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:47.482428 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:47.482894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:47.483581 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:47.484036 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:47.484461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:47.608990 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:47.616785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-45416989-5bbe-4d23-832e-e147a92235ed tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1690 microversion: 2.1 time: 0.146062 Sep 07 19:19:47.617346 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 313/616] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:47 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:47.814426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:47.815046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:47.821468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:47.821951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:47.822389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:47.823614 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:47.824111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:47.824508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:47.966148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:47.974334 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-53055ea4-d1c8-40e7-92c3-7bc7a1738287 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.163967 Sep 07 19:19:47.974940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 304/617] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:47 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:48.639695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:48.640333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:48.646204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:48.646714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:48.647146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:48.647832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:48.648285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:48.648705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:48.778839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:48.786527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b81751ef-84b3-49a6-b688-84a9bda8900d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1690 microversion: 2.1 time: 0.150752 Sep 07 19:19:48.787120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 314/618] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:48 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:48.997211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:48.997821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:49.004215 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:49.004696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:49.005129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:49.005823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:49.006279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:49.006736 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:49.145859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:49.154962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5f2101ba-5a8f-4ce7-b200-149274a1e0ef tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.161594 Sep 07 19:19:49.155535 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 305/619] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:48 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:49.810148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:49.810810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:49.816736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:49.817213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:49.817641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:49.818321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:49.818798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:49.819288 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:49.949147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:49.956843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bb8bf3e1-623e-4cd2-aa24-3f50f7b150cc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1690 microversion: 2.1 time: 0.151316 Sep 07 19:19:49.957350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 315/620] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:49 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:50.178663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:50.180474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:50.186205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:50.186780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:50.187212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:50.187894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:50.188338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:50.188753 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:50.331931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:50.340621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e7852ad0-15ae-47c5-9ba7-2ed40e34c46f tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.165935 Sep 07 19:19:50.341192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 306/621] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:50 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:50.985071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:50.986106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad2f433-f9af-4cc9-be0a-46dcf22a831f", "name": "network-vif-deleted", "tag": "32de7d71-f773-464e-823c-03a5051d6516"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:19:50.987083 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:50.998674 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:50.999147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:50.999575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:51.000268 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:51.000742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:51.001158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:51.006784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:51.007275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:51.007684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:51.019239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] Creating event network-vif-deleted:32de7d71-f773-464e-823c-03a5051d6516 for instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f on hv-cinder-84773 Sep 07 19:19:51.024534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-9723ef29-2ee3-4ab1-afc4-0756ef107b9f req-89e262c9-58e9-41db-825d-aa609ac3efc5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047949 Sep 07 19:19:51.025517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 316/622] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:19:51.077921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:51.087375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-aff595f3-bb82-4537-8f2b-767f5d41504d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1622 microversion: 2.1 time: 0.110263 Sep 07 19:19:51.087951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 307/623] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:50 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:51.365575 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:51.366197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:51.372599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:51.373088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:51.373526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:51.374233 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:51.374711 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:51.375135 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:51.536509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:51.548565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-acc419c1-ea40-4cec-a4db-be81fbc41177 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.187233 Sep 07 19:19:51.549794 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 317/624] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:51 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:19:52.126313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:52.127104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:52.134325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:52.134743 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:52.135183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:52.136461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:52.136872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:52.137301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:52.172950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:52.173364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:52.173802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:52.174252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'fault' on Instance uuid 3ad2f433-f9af-4cc9-be0a-46dcf22a831f {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:19:52.216205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:52.223866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0b9f13f8-f332-4905-81ac-bf001329c2ea tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 200 len: 1336 microversion: 2.1 time: 0.101686 Sep 07 19:19:52.228409 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 308/625] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:52 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:52.571984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:52.572774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:52.579141 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:52.579626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:52.580064 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:52.580758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:52.581240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:52.581665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:52.720895 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:52.728999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-991c723c-e23d-45e4-b03c-3008f69881b3 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.161135 Sep 07 19:19:52.729568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 318/626] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:52 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:53.247220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:53.247875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 3ad2f433-f9af-4cc9-be0a-46dcf22a831f] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:53.254171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:53.254691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:53.255113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:53.255799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:53.256244 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:53.256664 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:53.269484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] HTTP exception thrown: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Request method failure captured: Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f HTTP/1.1 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2bSgW7NxNjsZMDzfspirglJy-FLJ60CpkCUJFORZBJJZcdp-bxaMIPWakmrU-8jZjCIQ71ztK8vvSSDzS-uJ3tksUT8QWTaPBpQV_qszxcehEDPQUsOR84-8yrN_HE1HHGRl9amoIAAvwhHGCl8cIAUMtp6MPX4Sh3CIUbLiAX0A8 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:19:53.271109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 847f6bef4e7b44f4b0adf1bda9dadb7e Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. Sep 07 19:19:53.272712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '3ad2f433-f9af-4cc9-be0a-46dcf22a831f'} Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:19:53.273857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. Sep 07 19:19:53.275657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:19:53.277662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Returning 404 to user: Instance 3ad2f433-f9af-4cc9-be0a-46dcf22a831f could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:19:53.277662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-231111f3-123a-4e6c-a9f2-9a04ab49aa9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f" status: 404 len: 111 microversion: 2.1 time: 0.029189 Sep 07 19:19:53.277662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 309/627] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:53 2022] GET /compute/v2.1/servers/3ad2f433-f9af-4cc9-be0a-46dcf22a831f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:19:53.281741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-80cf7a0d-ceb4-4d61-8385-a711479a13d1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '.version_select at 0x7ff4dbcec700>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:53.359477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-80cf7a0d-ceb4-4d61-8385-a711479a13d1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916582303" status: 202 len: 0 microversion: 2.1 time: 0.081465 Sep 07 19:19:53.360060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 319/628] 10.222.0.46 () {58 vars in 1221 bytes} [Wed Sep 7 19:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916582303 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:19:53.752136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:53.752825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:53.758854 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:53.759411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:53.759850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:53.760545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:53.761026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:53.761450 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:53.779605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:19:53.973384 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:53.982262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2972d0b7-eefb-412c-9d7f-1de40388ce03 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.234226 Sep 07 19:19:53.982870 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 310/629] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:53 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:55.005499 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:55.006138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:55.011999 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:55.012480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:55.012908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:55.013593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:55.014045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:55.014465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:55.152357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:55.160497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-84054bab-80df-4714-b05a-20eb90976744 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1756 microversion: 2.1 time: 0.158973 Sep 07 19:19:55.161065 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 320/630] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:55 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:56.184001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:56.184646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:56.191177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:56.191655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:56.192084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:56.192771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:56.193221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:56.193640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:56.593214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:56.601437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3c93d4b6-9f49-46bc-a714-8e23d0a78468 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1759 microversion: 2.1 time: 0.421928 Sep 07 19:19:56.601997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 311/631] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:56 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1759 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:56.657519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:56.658038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:56.664010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:56.664488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:56.664920 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:56.665604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:56.666052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:56.666476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:56.690922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:19:56.986060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fdd6edc9-2881-422f-86e8-56932fb85d9f tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 204 len: 0 microversion: 2.1 time: 0.332065 Sep 07 19:19:56.986723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 321/632] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:19:56 2022] DELETE /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:19:56.995505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:56.996208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:57.002512 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:57.003017 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:57.003457 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:57.004155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:57.004610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:57.005037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:57.129424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:57.138268 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-02bc99c7-4d25-44f7-a191-20534c39f9dc tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1506 microversion: 2.1 time: 0.147461 Sep 07 19:19:57.138889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 312/633] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:56 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:58.162042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:58.162760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:58.169844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:58.170355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:58.170836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:58.171766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:58.172251 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:58.172714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:58.303223 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:58.310875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-be6e1225-0e3f-4c08-adea-3aaac672e28a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1506 microversion: 2.1 time: 0.153328 Sep 07 19:19:58.311440 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 322/634] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:58 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:19:59.333480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:19:59.334097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:19:59.341290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:59.341774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:59.342208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:59.342943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:19:59.343402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:19:59.343829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:19:59.469126 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:19:59.476759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-600285a6-60d4-4b9c-b7a3-610f925791ef tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1506 microversion: 2.1 time: 0.147225 Sep 07 19:19:59.477324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 313/635] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:19:59 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:00.098868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f3725f-cd16-4277-be1b-ef47b8c92ca0", "name": "network-vif-deleted", "tag": "13fb3160-88c3-471a-834d-9476f251fa88"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:00.108319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:00.108788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:00.109214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:00.120956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] Creating event network-vif-deleted:13fb3160-88c3-471a-834d-9476f251fa88 for instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 on hv-cinder-84773 Sep 07 19:20:00.126655 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-7578c5a5-48dc-429b-9795-3292b063b004 req-9eedfe8d-5f12-4db6-84c8-d1ceb85ddd35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089925 Sep 07 19:20:00.127531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 323/636] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:00.501967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:00.506106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:00.510452 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:00.511004 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:00.511444 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:00.512137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:00.512588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:00.513007 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:00.546967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:00.547369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:00.547805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:00.548253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lazy-loading 'fault' on Instance uuid 88f3725f-cd16-4277-be1b-ef47b8c92ca0 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:20:00.589095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:00.596652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bb8f8a85-72a1-40b3-81bd-f03c41eb255d tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 200 len: 1311 microversion: 2.1 time: 0.098731 Sep 07 19:20:00.597230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 314/637] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:00 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:01.621367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:01.622068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: 88f3725f-cd16-4277-be1b-ef47b8c92ca0] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:01.628285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.628766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.629199 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:01.629890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.630446 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.630905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:01.635202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:01.644734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] HTTP exception thrown: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Request method failure captured: Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 HTTP/1.1 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2bSgW7NxNjsZMDzfspirglJy-FLJ60CpkCUJFORZBJJZcdp-bxaMIPWakmrU-8jZjCIQ71ztK8vvSSDzS-uJ3tksUT8QWTaPBpQV_qszxcehEDPQUsOR84-8yrN_HE1HHGRl9amoIAAvwhHGCl8cIAUMtp6MPX4Sh3CIUbLiAX0A8 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:20:01.649729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 847f6bef4e7b44f4b0adf1bda9dadb7e Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. Sep 07 19:20:01.651486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '88f3725f-cd16-4277-be1b-ef47b8c92ca0'} Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:20:01.652267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. Sep 07 19:20:01.653502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:01.654572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Returning 404 to user: Instance 88f3725f-cd16-4277-be1b-ef47b8c92ca0 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:20:01.654572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38905321-1ccb-4e4d-8f4c-6d525e5e029a tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0" status: 404 len: 111 microversion: 2.1 time: 0.031325 Sep 07 19:20:01.654572 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 324/638] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:01 2022] GET /compute/v2.1/servers/88f3725f-cd16-4277-be1b-ef47b8c92ca0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:20:01.656425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:01.656925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:01.663379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.663866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.664304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:01.664999 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.665456 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.665885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:01.690914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:20:01.890037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9c67c354-dd46-4f43-a19d-ff945af19cd1 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 204 len: 0 microversion: 2.1 time: 0.237061 Sep 07 19:20:01.890590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 315/639] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:20:01 2022] DELETE /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:20:01.899369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:01.899981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:01.906281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.906798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.907254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:01.907961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:01.908412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:01.908831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:02.044773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:02.052476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-734f256c-1fa8-4f33-aa65-a3d8e30ab5ff tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.157632 Sep 07 19:20:02.053049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 325/640] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:01 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:03.076281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:03.076985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:03.083454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:03.083941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:03.084382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:03.085076 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:03.085530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:03.085954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:03.216796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:03.224570 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fae3a83b-d1cc-447e-b453-e4416598d815 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.153162 Sep 07 19:20:03.225143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 316/641] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:03 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:04.247640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:04.248249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:04.254309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:04.254816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:04.255246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:04.255925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:04.256484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:04.256907 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:04.387672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:04.395332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-950b9f10-4715-4b8b-bc7b-f2fbe244dc74 tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1521 microversion: 2.1 time: 0.151672 Sep 07 19:20:04.395908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 326/642] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:04 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:05.135210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca91c2bd-b822-4ce2-82fa-605aea3fb036", "name": "network-vif-deleted", "tag": "68a7b1dc-fa71-4330-94bf-fdf595322923"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:05.145393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:05.156527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:05.156527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:05.157906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] Creating event network-vif-deleted:68a7b1dc-fa71-4330-94bf-fdf595322923 for instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 on hv-cinder-84773 Sep 07 19:20:05.163254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-4c572133-1636-4071-9011-3ef0b3ec48b0 req-1b672f02-1ba4-465a-83c8-4a886d57412e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Sep 07 19:20:05.163836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 317/643] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:05.421079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:05.421079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:05.427098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:05.427592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:05.428030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:05.428740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:05.429203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:05.429631 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:05.497985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '847f6bef4e7b44f4b0adf1bda9dadb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0ca8c7ab1e64a0bb02a4941fe7b8105', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:05.507631 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bb0f8ed4-81f2-4413-b005-2b479e48927e tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 200 len: 1306 microversion: 2.1 time: 0.092378 Sep 07 19:20:05.508416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 327/644] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:05 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:06.323292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:06.323978 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:06.330599 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:06.335066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:06.335066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:06.335066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:06.335066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:06.335500 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:06.356727 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a2e6d971-e0a7-40f6-9a53-1174793b03da tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/ips" status: 200 len: 151 microversion: 2.20 time: 0.146982 Sep 07 19:20:06.357290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 318/645] 10.222.0.46 () {60 vars in 1289 bytes} [Wed Sep 7 19:20:06 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/ips => generated 151 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:20:06.530855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:06.531403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] [instance: ca91c2bd-b822-4ce2-82fa-605aea3fb036] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:06.537335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:06.537817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:06.538246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:06.538964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:06.539416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:06.539843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:06.554943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] HTTP exception thrown: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Request method failure captured: Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 HTTP/1.1 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2bSgW7NxNjsZMDzfspirglJy-FLJ60CpkCUJFORZBJJZcdp-bxaMIPWakmrU-8jZjCIQ71ztK8vvSSDzS-uJ3tksUT8QWTaPBpQV_qszxcehEDPQUsOR84-8yrN_HE1HHGRl9amoIAAvwhHGCl8cIAUMtp6MPX4Sh3CIUbLiAX0A8 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:20:06.556454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f0ca8c7ab1e64a0bb02a4941fe7b8105"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: f0ca8c7ab1e64a0bb02a4941fe7b8105 Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884744904 Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 847f6bef4e7b44f4b0adf1bda9dadb7e Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884744904-project Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. Sep 07 19:20:06.558025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'ca91c2bd-b822-4ce2-82fa-605aea3fb036'} Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:20:06.559562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. Sep 07 19:20:06.560827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:06.561992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] Returning 404 to user: Instance ca91c2bd-b822-4ce2-82fa-605aea3fb036 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:20:06.561992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4ab372c8-72b8-4774-b7ce-a35a8fb9ca9c tempest-ServerRescueNegativeTestJSON-1884744904 tempest-ServerRescueNegativeTestJSON-1884744904-project] 10.222.0.46 "GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036" status: 404 len: 111 microversion: 2.1 time: 0.031193 Sep 07 19:20:06.561992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 328/646] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:06 2022] GET /compute/v2.1/servers/ca91c2bd-b822-4ce2-82fa-605aea3fb036 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:20:08.497028 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:08.497550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:08.504109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:08.505018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:08.505458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:08.506158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:08.506634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:08.507058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:08.538841 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'flavor' on Instance uuid 44de99b4-e142-474e-b405-0a33fee9b515 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:20:09.000174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3acee71f-7f1a-4a12-99b3-aa9e0030c631 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/action" status: 202 len: 0 microversion: 2.20 time: 0.506955 Sep 07 19:20:09.000920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 319/647] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Sep 7 19:20:08 2022] POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:20:09.009213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:09.009818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:09.016753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:09.017235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:09.017664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:09.018404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:09.018879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:09.019312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:09.148318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:09.156769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:09.158196 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:09.159358 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-44113e59-b7be-4cb7-a596-ad14350b55de tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.154058 Sep 07 19:20:09.159916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 329/648] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:09 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:10.185143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:10.185863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:10.195431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:10.195913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:10.196343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:10.197030 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:10.197478 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:10.197899 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:10.329948 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:10.338152 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:10.339651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:10.342405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b2758e6c-238d-498f-9de0-fa8911004177 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.161120 Sep 07 19:20:10.342405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 320/649] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:10 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:11.368740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:11.369351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:11.371228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:11.375855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:11.376374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:11.376842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:11.377528 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:11.377976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:11.378401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:11.509913 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:11.518799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:11.520346 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:11.521649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ec461281-7468-44d3-9ed3-dc4aef97579a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.157951 Sep 07 19:20:11.522208 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 330/650] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:11 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:12.548716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:12.549346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:12.551959 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:12.557129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:12.557609 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:12.558065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:12.559429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:12.559878 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:12.560294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:12.750043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:12.758173 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:12.759648 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:12.760828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-52b5f70d-6d30-4964-906d-f228b655da10 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.215975 Sep 07 19:20:12.761385 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 321/651] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:12 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:13.787075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:13.787680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:13.793911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:13.794477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:13.795020 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:13.795784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:13.796453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:13.797118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:14.076411 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:14.094450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:14.098266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:14.098266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-86102cb4-1d53-490b-aed7-bb6761a4e6cd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.314121 Sep 07 19:20:14.098266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 331/652] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:13 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:15.123568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:15.124378 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:15.130815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:15.131495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:15.132242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:15.132938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:15.133387 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:15.133802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:15.344345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:15.352398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:15.353875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:15.355158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2291a24b-7604-489e-aa78-5f4d742c9583 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.236243 Sep 07 19:20:15.356261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 322/653] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:15 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:16.381623 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:16.382224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:16.388314 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:16.388797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:16.389270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:16.390051 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:16.390505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:16.390954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:16.618588 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:16.628872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:16.633483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:16.633483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-829ee484-efb2-45eb-a017-ca9e4e7191b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.254367 Sep 07 19:20:16.633483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 332/654] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:16 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:17.659012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:17.659669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:17.665520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:17.666008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:17.666537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:17.667276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:17.667715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:17.668283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:17.748130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ad42a6de-fab2-4b6a-8edb-be61f95612a9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: .version_select at 0x7ff4da64e040>, body: {"keypair": {"name": "tempest-keypair-1781901917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFK4lt/TKAvPVAZUkBfNP2BbQ9QrPESCJW8MMskBFVWFuU7mxu5EvJtvk97pU6vgw8XucD2MYNt2s83xL2GmssH2/BIPdq+0wDpBeeuKRVuALi3cxKAVqcauI/k/TL85Gg=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:17.774920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ad42a6de-fab2-4b6a-8edb-be61f95612a9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for project 53d22963975b4bb891b1858f4afe3275. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:20:17.774920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ad42a6de-fab2-4b6a-8edb-be61f95612a9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for user 7c8142614fe149fd9593cfba97ecad18 and project 53d22963975b4bb891b1858f4afe3275. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:20:17.804878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:17.816305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:17.817911 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:17.819109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-74784f7e-036a-444f-9e54-b75d2f0e085a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.164160 Sep 07 19:20:17.819685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 333/655] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:17 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:17.891825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ad42a6de-fab2-4b6a-8edb-be61f95612a9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.261392 Sep 07 19:20:17.892430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 323/656] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:20:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:18.845155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:18.845833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:18.853246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:18.853740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:18.854182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:18.854980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:18.856167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:18.856566 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:19.017804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:19.028246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:19.031416 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:19.032008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c21b27c3-76db-4b86-b31e-530cacf590ec tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.190440 Sep 07 19:20:19.034589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 334/657] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:18 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:20.059416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:20.060029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:20.068515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:20.069008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:20.069454 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:20.070163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:20.070646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:20.071074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:20.204543 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-932280298", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f83fe1e5-d2ef-4bfd-98be-375651cb2f45"}], "security_groups": [{"name": "tempest-securitygroup--1621168767"}], "key_name": "tempest-keypair-1781901917", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:20.216102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:20.227134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:20.228180 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:20.229369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-912ab426-1d3f-4ec4-933b-142333c86bc3 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1744 microversion: 2.20 time: 0.173974 Sep 07 19:20:20.229935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 324/658] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:20 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:20.322359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] validate_networks() for [('f83fe1e5-d2ef-4bfd-98be-375651cb2f45', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:20:20.750785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:20:20.751244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:20:20.751800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:20:20.752279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:20:20.752758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:20:20.762016 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:20.762492 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:20.762949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:20.763699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:20.764143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:20.764555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:20.781837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for project 53d22963975b4bb891b1858f4afe3275. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:20:20.785903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for user 7c8142614fe149fd9593cfba97ecad18 and project 53d22963975b4bb891b1858f4afe3275. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:20:20.797540 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:20:20.799937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:20:20.922421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-64b1c2af-85a6-47e7-b402-e677ac528ec0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722127 Sep 07 19:20:20.923113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 335/659] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:20:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:20:20.934608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbf607b3-8f51-43b0-b88a-f42ea14661d4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:20.939623 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbf607b3-8f51-43b0-b88a-f42ea14661d4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:20.990882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbf607b3-8f51-43b0-b88a-f42ea14661d4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:21.000431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbf607b3-8f51-43b0-b88a-f42ea14661d4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1237 microversion: 2.1 time: 0.068965 Sep 07 19:20:21.000933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 325/660] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:20 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:21.256447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:21.257189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:21.265467 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:21.265954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:21.266387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:21.267120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:21.267612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:21.268025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:21.403810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:21.412238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:21.413744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:21.414946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-38e009fc-99e9-486b-bd49-16280c5ec483 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1744 microversion: 2.20 time: 0.163228 Sep 07 19:20:21.415510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 336/661] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:21 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:22.028956 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:22.029660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:22.037079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:22.039392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:22.039392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:22.039392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:22.039392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:22.039781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:22.043688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:22.100629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:22.108860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d1f29af6-dacf-4672-ac11-02374a0b0cfd tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1241 microversion: 2.1 time: 0.084777 Sep 07 19:20:22.122581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 326/662] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:22 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:22.443156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:22.444328 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:22.455302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:22.459783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:22.460898 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:22.462220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:22.462943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:22.464156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:22.609768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:22.620187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:22.623157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:22.625841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-74d5fa73-5cf7-465a-b28c-9b415162f880 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.187896 Sep 07 19:20:22.628768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 337/663] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:22 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:23.132849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:23.134709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:23.144249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:23.145018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:23.145612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:23.146483 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:23.147121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:23.147700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:23.235348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:23.248864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f038ef8f-d379-4b60-a4f1-a51fa39f6160 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1289 microversion: 2.1 time: 0.120176 Sep 07 19:20:23.249828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 327/664] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:23 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:23.663464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:23.664663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:23.671912 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:23.672639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:23.673246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:23.674113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:23.674749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:23.675327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:23.901183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:23.913788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:23.915335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:23.916516 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57cbbb5c-90f8-439b-b465-70e7ec11c53e tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.262496 Sep 07 19:20:23.917282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 338/665] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:23 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:24.275804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:24.279267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:24.289346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:24.290092 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:24.290746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:24.291661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:24.292272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:24.292736 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:24.386105 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:24.395100 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9bde4e83-97bc-4ca9-aa5c-3f62f8b6d087 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1295 microversion: 2.1 time: 0.125459 Sep 07 19:20:24.401416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 328/666] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:24 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:24.852596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "name": "network-vif-plugged", "status": "completed", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:24.875108 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:24.875916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:24.876713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:24.891965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] Creating event network-vif-plugged:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:20:24.898603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fb219c1a-aff1-4b17-84fa-b861c229beb5 req-c6cdef54-b9ac-4afc-a8a7-91888b61820b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143131 Sep 07 19:20:24.900426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 339/667] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:24.941415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:24.942831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:24.954319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:24.955018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:24.956407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:24.957310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:24.959120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:24.961568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:25.163670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:25.172990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:25.175310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:25.176705 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0477a7aa-e9ab-4e74-b3fd-1646545ae7b4 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.239315 Sep 07 19:20:25.186813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 329/668] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:24 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:25.424535 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:25.425172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:25.432042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:25.432540 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:25.433012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:25.433687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:25.434145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:25.434643 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:25.584247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:25.594905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-59a1b6aa-a9c9-4615-b4a9-359ec72888fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.175427 Sep 07 19:20:25.615897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 340/669] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:25 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:26.050505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00e0417-c632-48c2-86de-591aef7988a1", "tag": "d5c936e5-3c24-493f-ae49-d62d605c57ab"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:26.062040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:26.062530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:26.062997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:26.076508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] Creating event network-changed:d5c936e5-3c24-493f-ae49-d62d605c57ab for instance e00e0417-c632-48c2-86de-591aef7988a1 on hv-cinder-84773 Sep 07 19:20:26.081413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-49c0148c-ef1c-49a2-be0e-0403ac451fc6 req-34d65f35-3dc9-44ce-a584-29ce3ffb545b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034562 Sep 07 19:20:26.082011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 330/670] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:20:26.202746 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:26.203480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:26.209688 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:26.210431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:26.211156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:26.212068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:26.212728 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:26.213214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:26.382009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:26.395647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:26.402579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:26.405998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5c0547c9-4407-4177-9f0d-54348f9d3374 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.207289 Sep 07 19:20:26.406771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 341/671] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:26 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:26.617674 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:26.619047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:26.631229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:26.631756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:26.632195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:26.632906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:26.633358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:26.633776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:26.795772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:26.805561 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f1a6b830-eec3-4a63-8721-2e9105c3f4f7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.191901 Sep 07 19:20:26.806615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 331/672] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:26 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:27.439053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:27.440310 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:27.446879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:27.447611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:27.448048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:27.448757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:27.449212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:27.449640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:27.596058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:27.604927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:27.606458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:27.608738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6cf4c42d-555f-4718-bdc2-8cf13caa251f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.173613 Sep 07 19:20:27.610385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 342/673] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:27 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:27.829263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:27.830265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:27.837376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:27.838167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:27.841220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:27.842383 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:27.842971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:27.843630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:27.988686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:27.996903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f16e271c-1117-4acf-a24b-692db0123a22 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.171820 Sep 07 19:20:27.997792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 332/674] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:27 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:28.634905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:28.635797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:28.645547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:28.648295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:28.648295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:28.648295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:28.648295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:28.648663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:28.671172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:28.799076 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:28.818946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:28.820530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:28.821758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c74e1967-eb5b-404b-afeb-243e172d3b89 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.190834 Sep 07 19:20:28.834200 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 343/675] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:28 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:29.021903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:29.022505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:29.030306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:29.030829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:29.031272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:29.031977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:29.032436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:29.032863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:29.176593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:29.256668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-29489aca-d117-4633-9a62-547f1d19c187 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.167101 Sep 07 19:20:29.256668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 333/676] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:29 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:29.851217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:29.851816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:29.861676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:29.862174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:29.862642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:29.863644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:29.864116 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:29.864654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:30.030190 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:30.040617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:30.042731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:30.044212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-047ff6af-90a3-46d8-b08a-02dfabcbb19f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.197279 Sep 07 19:20:30.061703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 344/677] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:29 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:30.247708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:30.248380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:30.255250 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:30.255826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:30.256459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:30.257694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:30.257818 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:30.258342 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:30.408461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:30.416619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-503fd20b-8a54-43f5-be19-d0455109cdb3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.177918 Sep 07 19:20:30.417536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 334/678] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:30 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:31.072851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:31.073462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:31.077511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:31.077867 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:31.083040 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.083539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.083981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:31.084744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.085199 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.085626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:31.241762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:31.252580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:31.255102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:31.256233 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dcd59c7c-abee-47e1-bd40-20f9153d60ef tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.187467 Sep 07 19:20:31.270574 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 345/679] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:31 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:31.440515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:31.441061 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:31.444194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:31.448272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.448760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.449193 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:31.449921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.450387 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.450894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:31.593221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:31.601571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16ee53a6-0820-47a6-89a9-aa39a6684557 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.165085 Sep 07 19:20:31.602346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 335/680] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:31 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:31.965463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-196760056"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:31.966003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:31.975293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.975787 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.976245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:31.976920 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:31.977371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:31.977792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:32.141091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.network.security_group_api [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Removing security group 4b137f32-d7c5-42da-a35c-ed4ba0d6ce27 from port 65247852-26e5-4da8-826a-69179f8419cb Sep 07 19:20:32.283680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:32.284301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:32.290936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:32.291843 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:32.292632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:32.293621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:32.294898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:32.295687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:32.520217 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:32.528819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:32.530354 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:32.531560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6a68fe91-02e4-4fb5-816b-d5a7fb6c80f2 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.251821 Sep 07 19:20:32.532139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 336/681] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:32 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:32.626958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:32.627491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:32.633715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:32.634306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:32.634780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:32.635476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:32.635936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:32.636358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:32.775691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:32.783905 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8f90d658-9bf1-4f6c-8304-428f5b85c8ce tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.162098 Sep 07 19:20:32.784465 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 337/682] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:32 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:32.964098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c8a32457-39de-4a21-8f3d-60f492519300 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action" status: 202 len: 0 microversion: 2.1 time: 0.990871 Sep 07 19:20:32.964098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 346/683] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:20:31 2022] POST /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/action => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:20:33.040169 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:33.053880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.054646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.055052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.068908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] Creating event network-changed:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:20:33.074386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-ad097675-0263-418f-80ec-ba197e12b587 req-8c291540-f818-4934-aff7-0bb799c96b3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114538 Sep 07 19:20:33.075399 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 338/684] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:33.133417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00e0417-c632-48c2-86de-591aef7988a1", "name": "network-vif-plugged", "status": "completed", "tag": "d5c936e5-3c24-493f-ae49-d62d605c57ab"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:33.145128 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.145790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.146564 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.162097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] Creating event network-vif-plugged:d5c936e5-3c24-493f-ae49-d62d605c57ab for instance e00e0417-c632-48c2-86de-591aef7988a1 on hv-cinder-84773 Sep 07 19:20:33.168340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-1366a839-2e1a-4943-b22d-7705c8ca8f20 req-23c1cc0c-d6fa-4d28-a2a3-b141b7b31f7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038416 Sep 07 19:20:33.168946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 347/685] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:33.557831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:33.558534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:33.573287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.574247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.579217 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.581000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.581790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.582071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.809549 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:33.810800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:33.824681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.828802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.830918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.831875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:33.832579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:33.834970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:33.946827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:33.958823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:33.960876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:33.962804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fd5dc988-3370-4e1d-a557-a9490cebc753 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.409184 Sep 07 19:20:33.963694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 339/686] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:33 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:34.109763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:34.118637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-974bb97b-fcce-4a36-bb4d-daa9e2de222d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1363 microversion: 2.1 time: 0.314724 Sep 07 19:20:34.119889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 348/687] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:33 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:34.903341 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:34.903836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:34.911151 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:34.911630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:34.912060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:34.912744 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:34.913192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:34.913608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:34.994863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:34.994863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:34.995511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lazy-loading 'services' on Instance uuid 43b9483f-6d31-40bc-9903-f163367ead72 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:20:34.997303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:34.997790 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:34.998841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:34.999745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.000202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.000624 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.134173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:35.144568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:35.146027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:35.147245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-10d8b1c4-ae51-435d-9ecc-5c4a2b881b49 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1739 microversion: 2.20 time: 0.161157 Sep 07 19:20:35.147816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 349/688] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:34 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:35.152776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:35.162504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.163031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.163513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.175242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] Creating event network-changed:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:20:35.181149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-7ef3a932-2aae-4847-b20f-9a13f54e25e2 req-0e45fea8-ad60-4021-ab59-8fdfb7693a18 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Sep 07 19:20:35.182112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 350/689] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:35.188687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:35.189588 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:35.195933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.196514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.197120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.197991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.198445 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.199002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.230331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-94ac41e1-66cb-49fb-ad5b-fad9931414eb tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments/84558d84-e0c2-452f-995d-b5ac97d6df7d" status: 202 len: 0 microversion: 2.1 time: 0.330962 Sep 07 19:20:35.231201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 340/690] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:20:34 2022] DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments/84558d84-e0c2-452f-995d-b5ac97d6df7d => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:20:35.240568 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:35.243664 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:35.254021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.254021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.254021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.254021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.254420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.254420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.286227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5fed38cc-a83a-4e18-966e-a73ea352ae5a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050137 Sep 07 19:20:35.286819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 341/691] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:20:35 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:20:35.343330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:35.351168 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-88a50444-aefd-495f-8c32-1d3ff38ec8df tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1549 microversion: 2.1 time: 0.167678 Sep 07 19:20:35.351738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 351/692] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:35 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:35.374958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:35.375446 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:35.381370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.381783 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.382207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.382911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:35.383360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:35.383776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:35.461104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0eec61f4-0e32-4ea8-aa6a-15449c0f0509 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090729 Sep 07 19:20:35.461702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 342/693] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:20:35 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:36.173891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:36.174538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:36.180651 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:36.181138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:36.181574 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:36.182274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:36.182755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:36.186185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:36.299933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:36.303109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:36.309732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:36.310297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:36.310935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:36.311691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:36.312155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:36.312586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:36.322184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:36.332356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:36.333989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:36.335213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d3991b62-312f-4ca4-89af-b64f005dbf71 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1721 microversion: 2.20 time: 0.166166 Sep 07 19:20:36.335789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 352/694] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:36 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:36.346869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:36.347239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a6b3ddc6-c3e7-4ce6-89b6-2e4272caf73c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052007 Sep 07 19:20:36.347871 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 343/695] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:20:36 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:20:36.870188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00e0417-c632-48c2-86de-591aef7988a1", "tag": "d5c936e5-3c24-493f-ae49-d62d605c57ab"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:36.880222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:36.880932 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:36.881654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:36.894959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] Creating event network-changed:d5c936e5-3c24-493f-ae49-d62d605c57ab for instance e00e0417-c632-48c2-86de-591aef7988a1 on hv-cinder-84773 Sep 07 19:20:36.904414 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-63014d64-d5fc-4def-8bd2-bf4e94c6f366 req-b45ab3b9-3410-4e2f-a118-6637fa117808 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036244 Sep 07 19:20:36.905851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 353/696] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:37.361971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:37.362647 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:37.364227 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:37.367025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:37.369884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.370578 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.377678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.377678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.377678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.377678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.378069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.378069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.378069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.378069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.378429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.378429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.406386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eb67024e-8d25-4118-9ff3-fc16c045c44a tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046436 Sep 07 19:20:37.413975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 354/697] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:20:37 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 19:20:37.419626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:37.420690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:37.426771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.427256 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.427689 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.428444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:37.428896 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:37.429511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:37.525594 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:37.538539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:37.540039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:37.541513 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9c805bd9-1d9b-48eb-a50b-8e9e90ae2376 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1721 microversion: 2.20 time: 0.183976 Sep 07 19:20:37.541947 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 344/698] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:37 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:37.553802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] HTTP exception thrown: Instance 43b9483f-6d31-40bc-9903-f163367ead72 is not attached to volume 84558d84-e0c2-452f-995d-b5ac97d6df7d Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Request method failure captured: Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments/84558d84-e0c2-452f-995d-b5ac97d6df7d HTTP/1.1 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO5y5VR373ngmN1gEXDWSRuWRUrjFtIhPD9XEQMIZgNHmuMt9eAJOdC5jm9fxej11cJ9j8tIGGj8_A5bYJYe5VM14ruu_f8__hKpE4xWbH5vvjBH5YhCf2r6M1UPdO_UHkDjgXHe1wPMsdGZ0wune9pDM2I74FxPr7Eqnei-gHY_SUw Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 7e249e6872c846beaefe3f9b760b6319 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:20:37.556329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 7e249e6872c846beaefe3f9b760b6319 Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-TestMinimumBasicScenario-2062225218-project Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: ddd54dd8bc3b41f3b649c2a26e5b54fe Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestMinimumBasicScenario-2062225218-project Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:20:37.557759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 43b9483f-6d31-40bc-9903-f163367ead72 is not attached to volume 84558d84-e0c2-452f-995d-b5ac97d6df7d Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'server_id': '43b9483f-6d31-40bc-9903-f163367ead72', 'id': '84558d84-e0c2-452f-995d-b5ac97d6df7d'} Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84558d84-e0c2-452f-995d-b5ac97d6df7d. Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:20:37.558533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b9483f-6d31-40bc-9903-f163367ead72 is not attached to volume 84558d84-e0c2-452f-995d-b5ac97d6df7d Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b9483f-6d31-40bc-9903-f163367ead72 is not attached to volume 84558d84-e0c2-452f-995d-b5ac97d6df7d Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:37.559996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Returning 404 to user: Instance 43b9483f-6d31-40bc-9903-f163367ead72 is not attached to volume 84558d84-e0c2-452f-995d-b5ac97d6df7d {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:20:37.561668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9206417d-9b7c-4eaa-9674-6ad23219fd5d tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments/84558d84-e0c2-452f-995d-b5ac97d6df7d" status: 404 len: 154 microversion: 2.1 time: 0.142130 Sep 07 19:20:37.561668 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 355/699] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:20:37 2022] DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72/os-volume_attachments/84558d84-e0c2-452f-995d-b5ac97d6df7d => generated 154 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:20:38.568866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:38.570182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:38.584843 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:38.585332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:38.585980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:38.587776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:38.588407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:38.589023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:38.687896 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "name": "network-vif-unplugged", "status": "completed", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:38.699208 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:38.699797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:38.700332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:38.713777 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] Creating event network-vif-unplugged:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:20:38.720912 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-31e30473-50de-4042-8e07-23080c584459 req-85b4007b-4aa8-4c35-ae2d-ea0087928cda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043793 Sep 07 19:20:38.722022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 356/700] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:20:38.751417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:38.759629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:38.761070 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:38.762280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b9fc80a4-50d9-44a8-9a8e-b38613743a57 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1721 microversion: 2.20 time: 0.197633 Sep 07 19:20:38.762908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 345/701] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:38 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:38.848179 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:38.848943 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:38.855279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:38.855781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:38.856218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:38.857666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:38.858299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:38.859122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:38.886129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:20:39.118530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0bfb1bd3-eed1-408c-b822-fb2237425171 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 204 len: 0 microversion: 2.1 time: 0.274504 Sep 07 19:20:39.119196 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 357/702] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:20:38 2022] DELETE /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:20:39.127320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:39.127938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:39.133979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.134605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.135050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:39.135748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.136203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.136627 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:39.276506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:39.285111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3d41e1c1-00e5-49cc-99eb-ebd5cc14889e tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1554 microversion: 2.1 time: 0.161670 Sep 07 19:20:39.285699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 346/703] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:39 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:39.791066 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:39.791691 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:39.797553 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.798025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.798452 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:39.799159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.799604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.800024 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:39.926353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:39.934436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:39.936448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:39.937599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5f53d390-58eb-4a37-939f-22a81e24b0ff tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1724 microversion: 2.20 time: 0.150940 Sep 07 19:20:39.938164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 358/704] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:39 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:39.962707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2bc907a-4a53-45fd-afae-b94c223c967b"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:39.965147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:39.971580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.972063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.972499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:39.973194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:39.973649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:39.974074 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:40.307887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:40.308497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:40.315008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:40.315488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:40.315922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:40.316606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:40.317059 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:40.317482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:40.445266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:40.453405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-21606b17-2c1b-4ac8-b3fe-1bfdc2561372 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1554 microversion: 2.1 time: 0.149319 Sep 07 19:20:40.453989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 359/705] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:40 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:40.815305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-30d65b00-0513-4d86-9f41-7eafb982644b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.856541 Sep 07 19:20:40.815927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 347/706] 10.222.0.46 () {62 vars in 1364 bytes} [Wed Sep 7 19:20:39 2022] POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments => generated 188 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 19:20:40.946030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:40.946537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:40.953358 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:40.954025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:40.954464 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:40.955188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:40.955712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:40.956195 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.048577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:41.477488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:41.478286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:41.485935 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:41.486926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:41.487192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.487995 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:41.488695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:41.489221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.575458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b38ffc35-98d3-44c0-8769-4d98dc6a985b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments/f2bc907a-4a53-45fd-afae-b94c223c967b" status: 202 len: 0 microversion: 2.20 time: 0.633208 Sep 07 19:20:41.576696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 360/707] 10.222.0.46 () {60 vars in 1457 bytes} [Wed Sep 7 19:20:40 2022] DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments/f2bc907a-4a53-45fd-afae-b94c223c967b => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:20:41.643564 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:41.648697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:41.649403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:41.651589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:41.651719 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5481b9f4-91fc-420d-bb65-12e18acc0572 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1554 microversion: 2.1 time: 0.178199 Sep 07 19:20:41.652261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 348/708] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:41 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:20:41.656745 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:41.657295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:41.657922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.658644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:41.659418 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:41.660955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.693358 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 19:20:41.911774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b9483f-6d31-40bc-9903-f163367ead72", "name": "network-vif-deleted", "tag": "65247852-26e5-4da8-826a-69179f8419cb"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:41.921710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:41.922187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:41.922640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:41.933631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] Creating event network-vif-deleted:65247852-26e5-4da8-826a-69179f8419cb for instance 43b9483f-6d31-40bc-9903-f163367ead72 on hv-cinder-84773 Sep 07 19:20:41.938760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-5fc2cb87-8124-4dcc-847d-c72da3f6efe6 req-1a07b0df-0968-4ef4-8c60-480f2dd3d55f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Sep 07 19:20:41.939347 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 349/709] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:20:42.042391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f2af7670-4f48-4dee-96a3-f9e73d72ebc8 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/action" status: 202 len: 0 microversion: 2.20 time: 0.397393 Sep 07 19:20:42.043608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 361/710] 10.222.0.46 () {62 vars in 1319 bytes} [Wed Sep 7 19:20:41 2022] POST /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 19:20:42.052847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:42.054092 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:42.059739 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:42.060286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:42.060740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:42.061466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:42.061926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:42.062351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:42.196671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:42.205665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:42.207357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:42.208537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8cb752c4-cae6-4061-89d7-2afff6db3f16 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1672 microversion: 2.20 time: 0.159992 Sep 07 19:20:42.209104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 350/711] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:42 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:42.676023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:42.676726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:42.682857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:42.683337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:42.683767 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:42.684448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:42.684893 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:42.685812 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:42.715696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:42.716169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:42.716596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:42.717093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lazy-loading 'fault' on Instance uuid 43b9483f-6d31-40bc-9903-f163367ead72 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:20:42.757716 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddd54dd8bc3b41f3b649c2a26e5b54fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e249e6872c846beaefe3f9b760b6319', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:42.765993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d229c242-69b5-4e52-9a02-0923e47bc536 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 200 len: 1347 microversion: 2.1 time: 0.093890 Sep 07 19:20:42.766574 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 362/712] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:42 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:20:43.234797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:43.235416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:43.239748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:43.242655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:43.243146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:43.243582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:43.244336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:43.244792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:43.245218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:43.377612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:43.385640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:43.387124 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:43.388313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-25372775-e369-4d40-a57d-a4adab959da9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1674 microversion: 2.20 time: 0.158003 Sep 07 19:20:43.388871 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 351/713] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:43 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:43.789940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:43.790479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] [instance: 43b9483f-6d31-40bc-9903-f163367ead72] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:43.796406 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:43.796882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:43.797313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:43.797994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:43.798442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:43.798886 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:43.811809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] HTTP exception thrown: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Request method failure captured: Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 HTTP/1.1 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO5y5VR373ngmN1gEXDWSRuWRUrjFtIhPD9XEQMIZgNHmuMt9eAJOdC5jm9fxej11cJ9j8tIGGj8_A5bYJYe5VM14ruu_f8__hKpE4xWbH5vvjBH5YhCf2r6M1UPdO_UHkDjgXHe1wPMsdGZ0wune9pDM2I74FxPr7Eqnei-gHY_SUw Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 7e249e6872c846beaefe3f9b760b6319 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:20:43.813415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e249e6872c846beaefe3f9b760b6319"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 7e249e6872c846beaefe3f9b760b6319 Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2062225218 Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-TestMinimumBasicScenario-2062225218-project Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: ddd54dd8bc3b41f3b649c2a26e5b54fe Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestMinimumBasicScenario-2062225218-project Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. Sep 07 19:20:43.815039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '43b9483f-6d31-40bc-9903-f163367ead72'} Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:20:43.815972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. Sep 07 19:20:43.817462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:20:43.818870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Returning 404 to user: Instance 43b9483f-6d31-40bc-9903-f163367ead72 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:20:43.818870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c50016eb-d630-4ecf-b2ef-a3effbbba077 tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72" status: 404 len: 111 microversion: 2.1 time: 0.028816 Sep 07 19:20:43.818870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 363/714] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:20:43 2022] GET /compute/v2.1/servers/43b9483f-6d31-40bc-9903-f163367ead72 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:20:43.823442 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-803e3bd6-f138-42e7-b3f9-ebf5c86e745c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] Calling method '.version_select at 0x7ff4ddb8d940>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:43.902510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-803e3bd6-f138-42e7-b3f9-ebf5c86e745c tempest-TestMinimumBasicScenario-2062225218 tempest-TestMinimumBasicScenario-2062225218-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-64573902" status: 202 len: 0 microversion: 2.1 time: 0.082706 Sep 07 19:20:43.903127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 352/715] 10.222.0.46 () {58 vars in 1266 bytes} [Wed Sep 7 19:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-64573902 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:20:44.414947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:44.415392 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:44.421480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:44.421974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:44.422410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:44.423147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:44.423630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:44.427743 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:44.558011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:44.567188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:44.568743 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:44.569910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1978832b-3935-4653-9157-5bf0692a934b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.159277 Sep 07 19:20:44.570470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 364/716] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:44 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 19:20:45.597545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:45.599221 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:45.607717 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:45.608314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:45.608863 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:45.609636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:45.610187 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:45.610720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:45.873447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:45.885458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:45.887208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:45.888591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-58da7bf8-b12a-4023-8228-0c0ab56f4409 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.297198 Sep 07 19:20:45.902578 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 353/717] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:45 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:46.914936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:46.916229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:46.923218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:46.924029 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:46.924680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:46.925600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:46.926263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:46.926936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:47.171632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:47.180619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:47.187390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:47.187390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5b41964a-ffd8-4d64-9fce-8a122dd65f3b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.274559 Sep 07 19:20:47.187390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 365/718] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:46 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:48.220751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:48.224849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:48.228204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:48.228738 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:48.229178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:48.229916 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:48.230370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:48.231148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:48.502344 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:48.523205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:48.523205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:48.524524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0fd89042-a7c4-45dd-9d1f-da656eb9bdce tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.310640 Sep 07 19:20:48.525646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 354/719] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:48 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:49.555145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:49.556383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:49.564877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:49.565367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:49.570502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:49.570502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:49.570502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:49.570502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:49.804806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:49.815791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:49.818049 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:49.820604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6923aa09-76dd-44e9-b1c5-50792eac918a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.269620 Sep 07 19:20:49.821374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 366/720] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:49 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:50.852861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:50.856157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:50.859996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:50.860697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:50.861137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:50.861837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:50.862297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:50.862753 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:51.100894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:51.110670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:51.112412 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:51.113787 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6c93e6d6-d957-4663-bb15-e108dcab432a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.264737 Sep 07 19:20:51.114355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 355/721] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:50 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:52.142358 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:52.145308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:52.155603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:52.156336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:52.157053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:52.158027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:52.158481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:52.158956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:52.349744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:52.361130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:52.365780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:52.367435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-de625bde-fed6-4b02-a040-ae3a09a55ccf tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.230326 Sep 07 19:20:52.374844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 367/722] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:52 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:53.404423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:53.405096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:53.412224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:53.412786 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:53.413287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:53.414059 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:53.414624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:53.415150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:53.650821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:53.660876 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:53.662328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:53.663744 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-74f2a3e9-7d1b-4bc8-9cc1-618fcac270a1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.264236 Sep 07 19:20:53.664325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 356/723] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:53 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:54.689492 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:54.690101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:54.696060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:54.696538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:54.696974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:54.697663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:54.698120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:54.698542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:54.830926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:54.839055 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:54.840501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:54.841654 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f1d32e61-f946-4092-a6d7-ea4ee299cb4a tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.156636 Sep 07 19:20:54.842323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 368/724] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:54 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:55.866892 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:55.867656 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:55.874785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:55.875282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:55.875718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:55.876503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:55.876956 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:55.877385 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:56.017271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:56.026251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:56.028058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:56.029283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d2784773-41df-4728-b31e-8ec200eda4eb tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.166475 Sep 07 19:20:56.029850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 357/725] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:55 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:57.055164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:57.055783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:57.062456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:57.062996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:57.063433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:57.064127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:57.064582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:57.065008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:57.192918 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:57.201734 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:57.203243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:57.204417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-29e4984e-f164-44e3-8599-6c34a39ba905 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.153223 Sep 07 19:20:57.204995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 369/726] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:57 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:58.229603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:58.235283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:58.242247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:58.242762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:58.243236 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:58.243943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:58.244401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:58.244828 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:58.378522 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:58.387005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:58.388499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:58.390242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0b399f40-8f06-4e6c-9b6f-6bee4c66c819 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.163957 Sep 07 19:20:58.390898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 358/727] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:58 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:20:58.823604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "name": "network-vif-plugged", "status": "completed", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:20:58.833465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:58.833939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:58.834363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:58.845135 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] Creating event network-vif-plugged:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:20:58.850181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-440d8ceb-bec2-4fe2-88da-58a219d728af req-9f5e626d-c7eb-429e-8d7e-f8b6921a949d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030289 Sep 07 19:20:58.850793 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 370/728] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:20:59.415120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:20:59.416313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:20:59.423389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:59.423897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:59.424330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:59.425020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:20:59.425468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:20:59.425888 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:20:59.443591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:20:59.553693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:59.561617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:59.563093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:20:59.564243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0c2c6c8f-4cb6-4f78-bc38-8637aa18ee8b tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.153140 Sep 07 19:20:59.564797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 359/729] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:20:59 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:00.589776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:00.590394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:00.598185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:00.598933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:00.599680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:00.600559 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:00.601035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:00.601457 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:00.733721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:00.741988 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:00.743380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:00.744581 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-030aa934-c5f7-432b-8627-33176876c5f9 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1730 microversion: 2.20 time: 0.159173 Sep 07 19:21:00.745263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 371/730] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:00 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:01.770949 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:01.771499 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:01.778188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:01.778700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:01.779138 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:01.779824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:01.780838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:01.781261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:01.913873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:01.921966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:01.923451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:01.924615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-309d0d68-1fa7-4412-901d-c3f7df5ad00c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1717 microversion: 2.20 time: 0.157680 Sep 07 19:21:01.925174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 360/731] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:01 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:03.153706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:03.154247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:03.160731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:03.161211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:03.161641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:03.162328 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:03.162806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:03.163230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:03.187816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:21:03.433090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5d399118-2641-43e7-bfbf-24b03bc10040 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 204 len: 0 microversion: 2.1 time: 0.283262 Sep 07 19:21:03.433673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 372/732] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:21:03 2022] DELETE /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 19:21:03.441960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:03.442593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:03.450302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:03.450860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:03.454815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:03.454815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:03.454815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:03.454815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:03.582690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:03.590381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0914e4f6-fae0-4a81-8417-f558db59d5a1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1578 microversion: 2.1 time: 0.152376 Sep 07 19:21:03.591050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 361/733] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:03 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:04.614909 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:04.615615 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:04.621520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:04.622007 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:04.622444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:04.623163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:04.624126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:04.624557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:04.761652 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:04.769587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9b72bdcc-c936-4cba-b64f-ce9eed1bfb02 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1578 microversion: 2.1 time: 0.159131 Sep 07 19:21:04.770180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 373/734] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:04 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:05.792411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:05.793024 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:05.800037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:05.800523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:05.800962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:05.801740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:05.802192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:05.802645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:05.869318 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:05.877375 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-77204fb3-f6b5-48f8-8f72-17e98b04825b tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1510 microversion: 2.1 time: 0.088888 Sep 07 19:21:05.878066 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 362/735] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:05 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:06.098680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9beb5e5-4d22-41df-8c6b-48336dccb119", "name": "network-vif-deleted", "tag": "57514c4b-7d26-49f2-8d0e-4f100199e0ee"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:06.114450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:06.114450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:06.114450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:06.118303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:06.125587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] Creating event network-vif-deleted:57514c4b-7d26-49f2-8d0e-4f100199e0ee for instance e9beb5e5-4d22-41df-8c6b-48336dccb119 on hv-cinder-84773 Sep 07 19:21:06.131044 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-624141e4-1530-4046-b4a5-1c9c19a18dfb req-185cc849-64a9-4d4f-87f9-8091b755885e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036121 Sep 07 19:21:06.131656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 374/736] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:06.901689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:06.902319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:06.909141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:06.909632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:06.910057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:06.910780 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:06.911228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:06.911642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:06.946822 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:06.947610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:06.948219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:06.948672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lazy-loading 'fault' on Instance uuid e9beb5e5-4d22-41df-8c6b-48336dccb119 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:21:06.990983 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:06.999508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-16499a2e-fbae-460a-a330-981c13a2e495 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 200 len: 1230 microversion: 2.1 time: 0.101263 Sep 07 19:21:07.000085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 363/737] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:06 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:08.023460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:08.024163 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:08.031398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:08.031862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:08.032300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:08.032995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:08.033451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:08.033878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:08.048126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] HTTP exception thrown: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Request method failure captured: Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 HTTP/1.1 Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO5NUrM6-xhCjd-_Gu2W9GpxenQZV_TsZ5_qV9uK-c77N5ow6QXD-S1jnmFl6YEzI1T4QWEDmJPmXcvpJJjJloWSdNDIutoEXhLy1M6Mp7xS9ppHcpJNYaqjRCgH5B8EGa2cmqe_S3WynbkLvGS7HBuUrrvSE890dPMeOy-MTBwJFOE Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:21:08.049736 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7847d148d828478b8124c8d08c8c582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f9db5f73350c460f99e4ab5cdbe6907a Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:21:08.051424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'e9beb5e5-4d22-41df-8c6b-48336dccb119'} Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:08.052487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:21:08.053888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:08.055349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Returning 404 to user: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:08.055349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db7a54bf-1c60-43a7-a6ac-7844e9c55839 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 404 len: 111 microversion: 2.1 time: 0.032044 Sep 07 19:21:08.055349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 375/738] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:08 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:21:08.149258 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-604314996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-290973285", "security_groups": [{"name": "tempest-secgroup-smoke-1301025987"}], "block_device_mapping_v2": [{"uuid": "6208c9ab-afe7-44a1-9373-6b2312f0f781", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7907def-f826-42d8-850a-2135619ed42f"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:08.265473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] validate_networks() for [('a7907def-f826-42d8-850a-2135619ed42f', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:21:08.722118 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:21:08.722565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:21:08.723044 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:21:08.723453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:21:08.723864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:21:08.732491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:08.733461 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:08.733896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:08.734653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:08.735111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:08.735537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:08.752391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:21:08.756525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for user f9db5f73350c460f99e4ab5cdbe6907a and project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:21:08.812617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:21:08.814850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6208c9ab-afe7-44a1-9373-6b2312f0f781',volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:21:09.230839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-75a88490-0f6e-43ba-8cf7-6a527bab85a2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.085704 Sep 07 19:21:09.232220 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 364/739] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:21:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:21:09.244188 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cec4f5dd-28a1-42bd-8a10-0d032b41d0b6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:09.244797 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cec4f5dd-28a1-42bd-8a10-0d032b41d0b6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:09.303876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cec4f5dd-28a1-42bd-8a10-0d032b41d0b6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:09.310779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cec4f5dd-28a1-42bd-8a10-0d032b41d0b6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1093 microversion: 2.1 time: 0.070744 Sep 07 19:21:09.311758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 376/740] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:09 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:10.334629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:10.335243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:10.341233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:10.341719 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:10.342148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:10.342868 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:10.343321 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:10.343740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:10.404148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:10.411954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-17519540-52b6-4e62-8bc2-cb2dcff84ea9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1135 microversion: 2.1 time: 0.081872 Sep 07 19:21:10.412514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 365/741] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:10 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:11.436422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:11.437706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:11.445650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:11.445923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:11.446359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:11.447116 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:11.447688 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:11.448120 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:11.513217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:11.521005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-659527ee-637e-49c0-9449-745873ab0a0d tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1209 microversion: 2.1 time: 0.088646 Sep 07 19:21:11.521559 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 377/742] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:11 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:12.544847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:12.545348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:12.556101 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:12.556504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:12.556931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:12.557631 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:12.558086 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:12.558508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:12.696529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:12.705196 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b5cf125-fc52-4fbb-99bf-de2f41c75d25 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1277 microversion: 2.1 time: 0.164152 Sep 07 19:21:12.706109 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 366/743] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:12 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:12.883285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d24d7c4-b04d-41c4-aa53-1c82c092238b", "tag": "3b5df254-fa92-4d47-9a66-372798980963"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:12.889672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:12.893940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:12.895305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:12.895305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:12.908148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] Creating event network-changed:3b5df254-fa92-4d47-9a66-372798980963 for instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b on hv-cinder-84773 Sep 07 19:21:12.913112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-50bc45b5-cd52-4627-b777-4ee5ad93e824 req-382426ed-8c34-4461-99bb-ec9cf3a6f5a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Sep 07 19:21:12.913713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 378/744] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:13.035075 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:13.035640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:13.042100 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:13.042885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:13.045792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:13.045792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:13.045792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:13.045792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:13.075140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7e9d71c6-9986-4342-8490-8a2003b7a5a0 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/ips" status: 200 len: 145 microversion: 2.1 time: 0.045088 Sep 07 19:21:13.078415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 367/745] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:21:13 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:13.729680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:13.730368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:13.737264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:13.737740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:13.738171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:13.738890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:13.739337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:13.739755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:13.871922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:13.880217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1c16c337-5cee-4b1a-a13e-62d68705a7bd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.155201 Sep 07 19:21:13.880817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 379/746] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:13 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:14.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:14.903254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:14.906077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:14.910764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:14.911249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:14.911688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:14.912380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:14.912836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:14.913274 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:15.048781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:15.056390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d1f5a00b-1f2a-4ba9-a52a-a1770192a75f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.157861 Sep 07 19:21:15.056948 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 368/747] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:14 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:16.078744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:16.079507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:16.085821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:16.086308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:16.086849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:16.087556 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:16.088013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:16.088441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:16.131826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efb9a752-e565-4823-8950-022d60510025"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:16.133845 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:16.140581 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:16.141069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:16.141505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:16.142214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:16.142699 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:16.143130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:16.224144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:16.231900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3c93862f-6c59-402a-9ac9-cd95a521ecda tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.156976 Sep 07 19:21:16.232476 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 380/748] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:16 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:16.750894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-437e72fb-56fc-489f-8ebd-e41efaf74a08 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623558 Sep 07 19:21:16.751500 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 369/749] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:21:16 2022] POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:21:17.255190 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:17.255804 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:17.262144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:17.262671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:17.263104 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:17.263795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:17.264246 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:17.264666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:17.393034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:17.400875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fb57d10b-b8e9-41eb-a67f-d554148110d8 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.149364 Sep 07 19:21:17.401448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 381/750] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:17 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:18.429262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:18.429922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:18.436408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:18.436890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:18.437324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:18.438018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:18.438474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:18.438953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:18.570436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:18.578819 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7ba7d656-495c-46af-9a50-3d611d915681 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.154286 Sep 07 19:21:18.579524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 370/751] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:18 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:19.601699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:19.602315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:19.604343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:19.609738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:19.614264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:19.614264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:19.614264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:19.614264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:19.614844 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:19.739113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:19.746755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-56022ba9-5712-477f-a0e5-ddfb8f823615 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.148944 Sep 07 19:21:19.751626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 382/752] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:19 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:20.770256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:20.770885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:20.772841 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:20.773778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:20.779488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:20.779963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:20.780890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:20.781571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:20.782014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:20.782429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:20.912939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:20.920550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1852675c-1273-41e2-b442-2094e4151a21 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.154160 Sep 07 19:21:20.921159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 371/753] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:20 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:21.943959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:21.944569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:21.950508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:21.951010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:21.951470 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:21.952148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:21.952592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:21.953009 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:22.084863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:22.092540 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fad64bd0-641f-4d67-a956-47725c220485 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.152510 Sep 07 19:21:22.093115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 383/754] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:21 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:23.115706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:23.116347 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:23.122774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:23.128179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:23.128179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:23.128179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:23.128179 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:23.128972 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:23.266133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:23.272087 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8942e4f7-d03f-4f2e-af8e-a62ccc3136f1 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.160312 Sep 07 19:21:23.272653 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 372/755] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:23 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:24.295385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:24.296101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:24.302769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:24.303254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:24.308519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:24.308519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:24.308519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:24.308519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:24.315216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:24.321640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:24.322128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:24.322589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:24.382474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Going to try to stop instance {{(pid=121079) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 19:21:24.439817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:24.447609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8debe221-297a-437c-9923-85657db8cffe tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.156213 Sep 07 19:21:24.448173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 384/756] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:24 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:24.579488 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8d2bdd2b-dda6-4634-a9e9-cf3750e6c302 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action" status: 202 len: 0 microversion: 2.1 time: 0.267938 Sep 07 19:21:24.580106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 373/757] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:21:24 2022] POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:21:24.588356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:24.599666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:24.599666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:24.599666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:24.599666 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:24.600214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:24.600214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:24.600214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:24.728052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:24.736378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a25351bc-e8ec-4ddd-806f-17eaf6de1158 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.151898 Sep 07 19:21:24.736947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 385/758] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:24 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:25.016292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d24d7c4-b04d-41c4-aa53-1c82c092238b", "name": "network-vif-plugged", "status": "completed", "tag": "3b5df254-fa92-4d47-9a66-372798980963"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:25.026047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:25.026540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:25.026967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:25.037586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] Creating event network-vif-plugged:3b5df254-fa92-4d47-9a66-372798980963 for instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b on hv-cinder-84773 Sep 07 19:21:25.042311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-bfd6429b-67e2-40e3-b19a-223d8dd77222 req-b80606bd-6dd4-46b3-bfe5-64afe3e93b78 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 Sep 07 19:21:25.042930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 374/759] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:21:25.471307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:25.471912 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:25.477816 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:25.478293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:25.478752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:25.479436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:25.479884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:25.480302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:25.606744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:25.614982 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e02df8a3-ae90-4eca-be27-7959e37275ec tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.148088 Sep 07 19:21:25.615550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 386/760] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:25 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:25.762137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:25.762824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:25.769560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:25.770047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:25.770485 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:25.771209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:25.771664 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:25.772091 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:25.776404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:25.902749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:25.911365 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ea411ed3-cabc-44d4-973e-9f688a72310f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.153946 Sep 07 19:21:25.911928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 375/761] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:25 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:26.637646 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:26.638350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:26.644696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:26.645170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:26.645600 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:26.646412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:26.646888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:26.647363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:26.777125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:26.784761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4e5bd5f-4075-4754-8b32-1ef198ecf95e tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1265 microversion: 2.1 time: 0.151168 Sep 07 19:21:26.785326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 387/762] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:26 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:26.934225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:26.934874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:26.941848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:26.942336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:26.942807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:26.943504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:26.943962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:26.944386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:27.079034 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:27.087359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af4dbbb4-9db5-4965-8992-e29508963a3c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.156956 Sep 07 19:21:27.087887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 376/763] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:26 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:27.807156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:27.807768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:27.813663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:27.814168 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:27.814642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:27.815331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:27.815784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:27.816204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:27.944119 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:27.952699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-168f0d11-d6ee-4b76-baac-43fad90e68aa tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1452 microversion: 2.1 time: 0.148828 Sep 07 19:21:27.953306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 388/764] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:27 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:27.975325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:27.975954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:27.982182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:27.982700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:27.983129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:27.983813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:27.984255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:27.984672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:28.112238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:28.112845 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:28.116390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:28.118706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:28.119182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:28.119612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:28.120297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:28.120738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:28.121153 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:28.124661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5601bc69-3739-4a22-ab01-5680d80679f6 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1452 microversion: 2.1 time: 0.153128 Sep 07 19:21:28.125236 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 377/765] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:27 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:28.263178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:28.271826 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f8196d62-db79-4bbb-aa04-b5787a458537 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.163430 Sep 07 19:21:28.272403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 389/766] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:28 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:29.296793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:29.297464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:29.304039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:29.304528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:29.304970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:29.305676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:29.306137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:29.306599 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:29.485655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:29.493834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bbdd3932-c646-4b29-b639-045b4addec5e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.201625 Sep 07 19:21:29.494401 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 378/767] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:29 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:30.356761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d24d7c4-b04d-41c4-aa53-1c82c092238b", "tag": "3b5df254-fa92-4d47-9a66-372798980963"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:30.366847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:30.367320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:30.367744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:30.380181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] Creating event network-changed:3b5df254-fa92-4d47-9a66-372798980963 for instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b on hv-cinder-84773 Sep 07 19:21:30.385198 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-447b803e-cdc8-4546-9112-7ed636533761 req-9e18d5fa-abcd-4bb9-8892-39c62ed93dbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 Sep 07 19:21:30.385981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 390/768] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:30.517237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:30.517851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:30.524449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:30.524939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:30.525372 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:30.526328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:30.526823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:30.527231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:30.658327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:30.666805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ae3b97d1-3c57-4b63-98fc-733e1e0bdead tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.153366 Sep 07 19:21:30.667395 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 379/769] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:30 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:31.691863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:31.692565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:31.698692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:31.699178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:31.699609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:31.700302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:31.700754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:31.701177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:31.830679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:31.838851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-362ada13-5e21-4b66-8e27-ba9a801f83a5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.151155 Sep 07 19:21:31.839423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 391/770] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:31 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:32.862032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:32.862698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:32.869460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:32.869940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:32.870380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:32.871172 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:32.871625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:32.872048 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:33.000060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:33.008276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-356c3dcf-dbea-4e16-93b1-1b33a7138550 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.150127 Sep 07 19:21:33.008842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 380/771] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:32 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:34.032615 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:34.033229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:34.039257 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:34.039740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:34.040172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:34.040863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:34.041313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:34.041738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:34.172675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:34.180882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c7c3645e-0c29-448c-ad8e-2c51c86492c1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1723 microversion: 2.1 time: 0.152119 Sep 07 19:21:34.181447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 392/772] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:34 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:35.138480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:35.141939 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:35.148114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.148588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.151629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.151629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.151629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.151629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.180265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c043b4f3-0727-4841-9b8b-7988c81fb2b0 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045702 Sep 07 19:21:35.180860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 381/773] 10.222.0.46 () {60 vars in 1343 bytes} [Wed Sep 7 19:21:35 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:35.207455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:35.207852 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:35.221099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.221795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.222498 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.223608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.224587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.225606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.251605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:35.252211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:35.258135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.259164 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.259303 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.260024 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.260547 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.261085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.288299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:21:35.367165 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:35.376519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4e4174c8-a7b5-4de3-a332-15f47aef9ae4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1700 microversion: 2.1 time: 0.175860 Sep 07 19:21:35.377092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 393/774] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:35 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1700 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:35.400270 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:35.406720 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.407209 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.407642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.455713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:35.467618 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Going to try to start instance {{(pid=121080) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 19:21:35.570630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bad5c77a-c25f-445f-90bc-cf06e339c6bd tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 204 len: 0 microversion: 2.20 time: 0.322913 Sep 07 19:21:35.571209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 382/775] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Sep 7 19:21:35 2022] DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 19:21:35.579908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:35.580607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:35.586466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.586994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.587431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.588115 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.588573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.588996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.635843 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-28807a55-3538-4fcf-aca6-c77f1e3e6f3f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action" status: 202 len: 0 microversion: 2.1 time: 0.239187 Sep 07 19:21:35.636569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 394/776] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:21:35 2022] POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:21:35.644913 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:35.645836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:35.652348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.652835 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.653307 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.653996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:35.654449 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:35.654966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:35.760886 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:35.769507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:35.770960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:35.772108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb6840f2-8280-4747-8e6f-6ca17f6fba17 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.196506 Sep 07 19:21:35.772671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 383/777] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:35 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:35.805621 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:35.813942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ff38ecfe-3f86-4226-ab65-3bb863ae8694 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1709 microversion: 2.1 time: 0.173124 Sep 07 19:21:35.814824 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 395/778] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:35 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:36.798439 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:36.799064 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:36.805507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:36.805994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:36.806432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:36.807168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:36.807626 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:36.808050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:36.836731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:36.837443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:36.843496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:36.844044 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:36.844538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:36.845291 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:36.845806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:36.846311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:36.988121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:36.996307 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:36.997839 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:36.999882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-651eff15-92d4-4dc1-9834-de27dde7128f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.204726 Sep 07 19:21:37.000447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 384/779] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:36 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:37.016622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:37.024872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2b76fb94-89d0-4cf4-a3d1-7c066271b054 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1709 microversion: 2.1 time: 0.192062 Sep 07 19:21:37.025444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 396/780] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:36 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:38.025313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:38.026851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:38.034002 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:38.034419 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:38.034884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:38.035591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:38.036046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:38.036610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:38.049048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:38.049665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:38.055920 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:38.058859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:38.058859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:38.058859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:38.058859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:38.059204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:38.239432 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:38.244410 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:38.245844 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:38.247078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8abb3599-d44f-4621-b501-4b197198a287 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1723 microversion: 2.20 time: 0.226115 Sep 07 19:21:38.247637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 385/781] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:38 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:38.261111 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:38.269339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-48a9bc19-ccf3-43a2-8358-feb07984ac4f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1709 microversion: 2.1 time: 0.224480 Sep 07 19:21:38.269977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 397/782] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:38 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1709 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:38.489772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44de99b4-e142-474e-b405-0a33fee9b515", "name": "network-vif-deleted", "tag": "c3143ea0-3e1d-4655-a0b3-87aab5423e22"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:38.501279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:38.501936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:38.502385 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:38.517973 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] Creating event network-vif-deleted:c3143ea0-3e1d-4655-a0b3-87aab5423e22 for instance 44de99b4-e142-474e-b405-0a33fee9b515 on hv-cinder-84773 Sep 07 19:21:38.523349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-36f07cd2-fdbf-4d60-b3b4-8b514f3d6c01 req-0697cbfa-bc76-40ef-8dc0-753bc89f8273 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038346 Sep 07 19:21:38.523953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 386/783] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:39.272753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:39.273363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:39.279754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:39.280352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:39.280681 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:39.281501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:39.281956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:39.282382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:39.300871 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:39.301795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:39.325020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:39.325525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:39.330040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:39.330848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:39.331764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:39.332411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:39.361980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:39.370972 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:39.372637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:39.374505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eedca416-e6bf-44b5-8aeb-1ce8dbe3a4be tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1366 microversion: 2.20 time: 0.105123 Sep 07 19:21:39.378625 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 398/784] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:39 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:39.478841 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:39.487640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-799efa28-cc42-4bd5-ab9b-c20ae4e1e0f3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1713 microversion: 2.1 time: 0.197431 Sep 07 19:21:39.488227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 387/785] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:39 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1713 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:21:40.400437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:40.401306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:40.407641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:40.408133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:40.408567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:40.409264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:40.409715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:40.410149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:40.440905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:40.441387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:40.441823 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:40.442269 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lazy-loading 'fault' on Instance uuid 44de99b4-e142-474e-b405-0a33fee9b515 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:21:40.484144 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:40.491376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:40.492828 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '920bdd998f0c4b62b108afc799a43964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7d9bc5395b4fa09a1024d20a980991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:40.493985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ac65f7d6-81bf-4814-bece-260bb99b869f tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 200 len: 1371 microversion: 2.20 time: 0.097526 Sep 07 19:21:40.494576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 399/786] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:40 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 19:21:41.529371 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:41.529927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:41.537124 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:41.537610 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:41.538047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:41.538779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:41.539235 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:41.539661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:41.553036 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 HTTP/1.1 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:21:41.554722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:41.556463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '44de99b4-e142-474e-b405-0a33fee9b515'} Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:41.557390 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:41.559023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:41.560380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:41.560380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13199576-56dd-4456-8b2c-44d99e9a279c tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 404 len: 111 microversion: 2.20 time: 0.031073 Sep 07 19:21:41.560380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 388/787] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:41 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:21:41.565514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c8c06da9-d60c-4f79-adc9-aecebbea15b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '.version_select at 0x7ff4da1cf430>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:41.645354 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c8c06da9-d60c-4f79-adc9-aecebbea15b6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133866481" status: 204 len: 0 microversion: 2.20 time: 0.083676 Sep 07 19:21:41.645946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 400/788] 10.222.0.46 () {60 vars in 1262 bytes} [Wed Sep 7 19:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133866481 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 19:21:43.674436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:43.674991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:43.681384 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:43.681861 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:43.682289 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:43.683001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:43.683449 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:43.683866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:43.697605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 HTTP/1.1 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:21:43.699146 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.700608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '44de99b4-e142-474e-b405-0a33fee9b515'} Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:43.701403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.702711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.703966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:43.703966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e41b4274-bfce-405e-b704-f105280f7ad6 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 404 len: 111 microversion: 2.20 time: 0.030404 Sep 07 19:21:43.703966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 389/789] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Sep 7 19:21:43 2022] DELETE /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:21:43.708733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:43.709486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 44de99b4-e142-474e-b405-0a33fee9b515] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:43.715326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:43.715803 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:43.716232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:43.716908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:43.717353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:43.717766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:43.730825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 HTTP/1.1 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:21:43.732421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.734606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '44de99b4-e142-474e-b405-0a33fee9b515'} Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:43.735425 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. Sep 07 19:21:43.736675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:43.737771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 44de99b4-e142-474e-b405-0a33fee9b515 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:43.737771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-658d9140-939f-48d8-a4a6-f45fd1c8b941 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515" status: 404 len: 111 microversion: 2.20 time: 0.029374 Sep 07 19:21:43.737771 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 401/790] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:43 2022] GET /compute/v2.1/servers/44de99b4-e142-474e-b405-0a33fee9b515 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 19:21:44.987243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:44.987769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:44.994234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:44.996135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:44.996135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:44.996135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:44.996501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:44.996849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:45.012879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 HTTP/1.1 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:21:45.014587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.016838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '22d755b0-e9a1-458b-816b-44554c028079'} Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:45.017630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.019362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.021047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:45.021047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-56bb1879-4441-4ff0-b00b-31883dbb2c05 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 404 len: 111 microversion: 2.20 time: 0.033464 Sep 07 19:21:45.021047 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 390/791] 10.222.0.46 () {60 vars in 1280 bytes} [Wed Sep 7 19:21:44 2022] DELETE /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:21:45.027233 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:45.027853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] [instance: 22d755b0-e9a1-458b-816b-44554c028079] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:45.029809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:45.034687 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:45.041095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:45.041095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:45.041095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:45.041095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:45.041490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:45.050432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] HTTP exception thrown: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Request method failure captured: Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 HTTP/1.1 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO2dXUaC5G09qWeLBLVbwroJgausynMfATh1_49QBc2ACYMUBRzabxk0689NS-mU2VvAUJk1MYnvFKXUeijIX_beAxqwzuiUPsrsLaZT21RMRZCp0l4UUuWDJmqUX8E11_ywNUtVZJY_rgeorkAUe2ilE5qT2q-HeWYzaaPX6i8NG6c Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:21:45.051968 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a7d9bc5395b4fa09a1024d20a980991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 8a7d9bc5395b4fa09a1024d20a980991 Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-652533603 Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 920bdd998f0c4b62b108afc799a43964 Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeShelveTestJSON-652533603-project Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.053629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '22d755b0-e9a1-458b-816b-44554c028079'} Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:21:45.054715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. Sep 07 19:21:45.055937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:21:45.057107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] Returning 404 to user: Instance 22d755b0-e9a1-458b-816b-44554c028079 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:21:45.057107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7852df6e-e736-42da-bdd4-05de86051ad1 tempest-AttachVolumeShelveTestJSON-652533603 tempest-AttachVolumeShelveTestJSON-652533603-project] 10.222.0.46 "GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079" status: 404 len: 111 microversion: 2.20 time: 0.030983 Sep 07 19:21:45.057107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 402/792] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Sep 7 19:21:45 2022] GET /compute/v2.1/servers/22d755b0-e9a1-458b-816b-44554c028079 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:21:55.607223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:55.607960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:55.725823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-caa7531a-d9d3-4935-b4ed-094798ea109f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: .version_select at 0x7ff4ddb28d30>, body: {"keypair": {"name": "tempest-keypair-941798447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiUpEndGC3xhwoPa6RZUV9ECXwL+fS2xTdJqRjRICUm/1Tl66K1KD/AL8eynAFggt8t+LVkX1roM+quKrHJU/N5Cx90Itbfzn0K+L9MPdVTTVzaikagdP8azcf+FqaTog=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:55.741673 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-caa7531a-d9d3-4935-b4ed-094798ea109f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:21:55.746216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-caa7531a-d9d3-4935-b4ed-094798ea109f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:21:55.857289 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-caa7531a-d9d3-4935-b4ed-094798ea109f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254983 Sep 07 19:21:55.857889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 391/793] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:21:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:21:58.014488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1848347940", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53498e05-b723-4a63-83c7-f76293f9aace"}], "security_groups": [{"name": "tempest-securitygroup--2016578842"}], "key_name": "tempest-keypair-941798447", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:21:58.023344 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:21:58.128090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] validate_networks() for [('53498e05-b723-4a63-83c7-f76293f9aace', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:21:58.526970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:21:58.527404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:21:58.528031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:21:58.528638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:21:58.529058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:21:58.538836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:58.539321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:58.539765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:58.540496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:21:58.540951 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:21:58.541376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:21:58.559019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:21:58.563212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:21:58.576723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:21:58.579241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:21:58.675929 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-06720d69-f982-40a3-b702-779e15713a0f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666079 Sep 07 19:21:58.676573 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 403/794] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:21:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:21:58.688618 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-14896470-5365-49bd-949f-4372b94c5670 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:58.690565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-14896470-5365-49bd-949f-4372b94c5670 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:58.752706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-14896470-5365-49bd-949f-4372b94c5670 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:58.761758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-14896470-5365-49bd-949f-4372b94c5670 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1241 microversion: 2.1 time: 0.077672 Sep 07 19:21:58.762336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 392/795] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:58 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:21:59.785022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7a36a511-a550-42c6-ba86-6cbfe1bc967a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:21:59.785578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7a36a511-a550-42c6-ba86-6cbfe1bc967a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:21:59.838081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7a36a511-a550-42c6-ba86-6cbfe1bc967a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:21:59.845871 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7a36a511-a550-42c6-ba86-6cbfe1bc967a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1241 microversion: 2.1 time: 0.065315 Sep 07 19:21:59.846526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 404/796] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:21:59 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:00.869058 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:00.869675 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:00.876324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:00.880350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:00.880350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:00.880350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:00.880350 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:00.880773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:00.941704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:00.949571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1489a04d-c538-4021-938d-e7935b1dbbc4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1293 microversion: 2.1 time: 0.084526 Sep 07 19:22:00.956476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 393/797] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:00 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:01.973864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:01.974637 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:01.981609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:01.982090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:01.982540 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:01.983297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:01.983750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:01.984176 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:02.137339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:02.145836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-acc0767e-374b-4b3d-a4cf-270446a6aa2a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.176220 Sep 07 19:22:02.146426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 405/798] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:01 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:02.975506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5", "tag": "b552e47b-69b2-4250-abb7-42139cc3a4d6"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:02.985949 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:02.986467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:02.986913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:02.997906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] Creating event network-changed:b552e47b-69b2-4250-abb7-42139cc3a4d6 for instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 on hv-cinder-84773 Sep 07 19:22:03.003809 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-6fc9cf96-bffb-4b9a-a73c-e444fab08617 req-d9b51f33-3ab5-4486-8691-96e48b142d34 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031162 Sep 07 19:22:03.003809 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 394/799] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:22:03.169403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:03.170127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:03.176164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:03.176649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:03.177083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:03.177784 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:03.178242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:03.178698 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:03.310496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:03.318129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d9039eb4-7a69-439d-b269-8d0947d309bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.152704 Sep 07 19:22:03.319097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 406/800] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:03 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:04.342587 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:04.343271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:04.349874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:04.350346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:04.351921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:04.351921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:04.351921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:04.352327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:04.477676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:04.485213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ae032b4-e35a-4519-b8f4-dfe6098e1830 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.147338 Sep 07 19:22:04.486363 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 395/801] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:04 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:05.508333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:05.508857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:05.514789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:05.515271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:05.515706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:05.517013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:05.517465 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:05.517888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:05.646667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:05.654579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a7478e64-932a-4ffb-8d68-9a9d6451be18 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.150176 Sep 07 19:22:05.655156 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 407/802] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:05 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:06.678745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:06.679310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:06.685898 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:06.686386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:06.686864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:06.687560 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:06.688052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:06.688544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:06.813480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:06.821090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7b6599ea-e121-4a65-9368-6c8a006457a6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.147046 Sep 07 19:22:06.821651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 396/803] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:06 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:07.844015 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:07.844630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:07.850832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:07.851272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:07.851712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:07.852403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:07.852857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:07.853281 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:07.985122 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:07.993309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f113f555-13be-4bf7-ae67-104b3d9015f1 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.153174 Sep 07 19:22:07.993879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 408/804] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:07 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:09.016199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:09.017408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:09.019795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:09.024537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:09.032071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:09.032071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:09.032071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:09.032071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:09.032477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:09.157398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:09.163157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8bb79197-9c18-4708-b61e-f637a0194999 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.150837 Sep 07 19:22:09.163726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 397/805] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:09 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:09.254626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5", "name": "network-vif-plugged", "status": "completed", "tag": "b552e47b-69b2-4250-abb7-42139cc3a4d6"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:09.259634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:09.264756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:09.265230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:09.265682 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:09.276820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] Creating event network-vif-plugged:b552e47b-69b2-4250-abb7-42139cc3a4d6 for instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 on hv-cinder-84773 Sep 07 19:22:09.281792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-693d915b-23db-4fda-bc29-0d2c26d3ab86 req-5f0e85d9-ca18-4be3-8669-65f016e44ed4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031446 Sep 07 19:22:09.282370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 409/806] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:22:10.185617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:10.186242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:10.193492 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:10.193970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:10.194404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:10.195116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:10.195569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:10.195991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:10.327719 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:10.335351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4a4f23c6-974c-4619-8925-7c77d5c74ff0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1367 microversion: 2.1 time: 0.153578 Sep 07 19:22:10.335914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 398/807] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:10 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:11.355809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=8 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:11.360180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:11.361089 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:11.368146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:11.368625 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:11.369054 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:11.369741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:11.370191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:11.370640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:11.504756 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:11.512527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dfe0123d-8468-45f6-9680-93e382525495 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1557 microversion: 2.1 time: 0.157707 Sep 07 19:22:11.513092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 410/808] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:11 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:11.538688 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:11.539218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:11.545634 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:11.547256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:11.547256 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:11.547484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:11.547745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:11.548171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:11.624347 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-08788734-d2a2-43d7-9434-2b30c603eb9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089455 Sep 07 19:22:11.624979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 399/809] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:22:11 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:22:12.722517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:12.723100 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:12.728894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:12.729380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:12.729817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:12.730505 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:12.730980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:12.731401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:12.817544 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lazy-loading 'services' on Instance uuid e00e0417-c632-48c2-86de-591aef7988a1 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:22:12.848482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5", "tag": "b552e47b-69b2-4250-abb7-42139cc3a4d6"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:12.859299 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:12.859865 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:12.860553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:12.873114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] Creating event network-changed:b552e47b-69b2-4250-abb7-42139cc3a4d6 for instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 on hv-cinder-84773 Sep 07 19:22:12.879356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b6081c66-c4bb-4fc6-b5fb-26af5ec3bffd req-e31d10ac-2032-42b8-a2b0-28d63966455a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034860 Sep 07 19:22:12.880032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 400/810] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:22:13.094448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-db6ececd-593a-43c8-bd7c-2c59a40bc993 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments/efb9a752-e565-4823-8950-022d60510025" status: 202 len: 0 microversion: 2.1 time: 0.375739 Sep 07 19:22:13.095088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 411/811] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:22:12 2022] DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments/efb9a752-e565-4823-8950-022d60510025 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:22:15.284990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:15.291275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:15.291753 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:15.292185 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:15.313252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Going to try to stop instance {{(pid=121079) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 19:22:15.515056 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e5e9c0f4-5852-47f2-869d-88654c3ab5e8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action" status: 202 len: 0 microversion: 2.1 time: 0.235044 Sep 07 19:22:15.515579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 401/812] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:22:15 2022] POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:22:15.524818 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:15.525523 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:15.531969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:15.532460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:15.532895 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:15.533597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:15.534060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:15.534483 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:15.663389 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:15.671029 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-94c42f22-670d-41c8-a420-71f038ab81fb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.150471 Sep 07 19:22:15.671604 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 412/813] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:15 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:16.695914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:16.696617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:16.702746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:16.703229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:16.703663 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:16.704349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:16.704796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:16.705864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:16.836701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:16.844724 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d32c9c1b-fd20-4036-90a2-b85dae2c1d48 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.153867 Sep 07 19:22:16.845314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 402/814] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:16 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:17.868215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:17.868820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:17.874838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:17.875322 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:17.875768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:17.876459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:17.876942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:17.877388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:18.004789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:18.012577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8dd0eb9c-5d8a-45ca-a35e-7131a8bcb9b4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.148332 Sep 07 19:22:18.013149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 413/815] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:17 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:19.036450 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:19.037065 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:19.043497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:19.043980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:19.044415 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:19.045104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:19.045554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:19.045974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:19.172470 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:19.180121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9e659bc5-5e57-43a6-9c10-0c84755982ef tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.147571 Sep 07 19:22:19.180684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 403/816] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:19 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:20.203917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:20.204438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:20.210971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:20.211458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:20.211894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:20.212589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:20.213043 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:20.213466 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:20.345303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:20.352825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d1b6dd3-6093-4f73-9374-cd59a55be03c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.152867 Sep 07 19:22:20.353380 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 414/817] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:20 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:21.376340 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:21.377551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:21.383661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:21.384148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:21.384589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:21.385283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:21.385741 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:21.386168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:21.510542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:21.518204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b05336e5-ffe2-4aa6-9760-7d4e929162de tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.146023 Sep 07 19:22:21.518796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 404/818] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:21 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:22.542184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:22.542748 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:22.549461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:22.549944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:22.550378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:22.551092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:22.551550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:22.552003 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:22.681882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:22.689527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d264e80e-b786-44ed-86db-5cc856875d01 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.151350 Sep 07 19:22:22.690090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 415/819] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:22 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:23.712233 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:23.712852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:23.719279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:23.719765 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:23.720205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:23.720938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:23.721420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:23.721850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:23.849046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:23.856763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6b18ce59-bae5-4a7f-be2f-3883a0bc6d1f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.148445 Sep 07 19:22:23.857323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 405/820] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:23 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:24.881323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:24.881961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:24.887922 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:24.888396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:24.888827 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:24.889510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:24.889959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:24.890379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:25.022015 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:25.030118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-24f44d0e-7ee8-4a4f-88c7-714a0dc175c4 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.153132 Sep 07 19:22:25.030707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 416/821] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:24 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:22:26.057959 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:26.058708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:26.061174 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:26.066713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:26.067201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:26.067640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:26.068364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:26.068824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:26.069251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:26.073281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:26.200319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:26.208495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ce462ed0-8a94-467b-ba88-311dec1199bb tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1677 microversion: 2.1 time: 0.154411 Sep 07 19:22:26.209097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 406/822] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:26 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:27.232732 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:27.233273 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:27.239493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:27.239979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:27.240421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:27.241154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:27.241609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:27.242035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:27.367965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:27.375571 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2ed053b7-25ac-4267-be0c-182a8976c2ed tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1654 microversion: 2.1 time: 0.147040 Sep 07 19:22:27.376145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 417/823] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:27 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:27.399453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:27.406793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:27.407276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:27.407711 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:27.429077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Going to try to start instance {{(pid=121079) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 19:22:27.634025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d4aebe21-2d6c-44d7-a4a0-7882822ab81c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action" status: 202 len: 0 microversion: 2.1 time: 0.238862 Sep 07 19:22:27.634654 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 407/824] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:22:27 2022] POST /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:22:27.642928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:27.643547 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:27.649524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:27.651201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:27.651201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:27.651201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:27.651903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:27.652326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:27.782762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:27.790674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b0568776-d841-44b8-b3c8-306d8bcd5ea8 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1663 microversion: 2.1 time: 0.151762 Sep 07 19:22:27.791262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 418/825] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:27 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:28.815919 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:28.816607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:28.822817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:28.823288 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:28.823764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:28.824456 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:28.824913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:28.825338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:28.953052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:28.961618 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dc3235fd-ecaf-4532-ab53-65faf3e64395 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1663 microversion: 2.1 time: 0.150905 Sep 07 19:22:28.962189 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 408/826] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:28 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:29.988181 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:29.988795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:29.990853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:29.995529 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:29.996017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:29.996458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:29.997177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:29.997603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:29.998028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:30.002574 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:30.131618 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:22:30.141562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e2372b7c-f526-4a75-8367-adea35602f1d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1667 microversion: 2.1 time: 0.158001 Sep 07 19:22:30.142568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 419/827] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:22:29 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:22:48.595804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:22:48.596379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:48.598909 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=5 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:48.599574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:22:48.604424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:48.608437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:48.608437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:48.608437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:48.608437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:48.608879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:48.631040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e828d175-7620-4b91-822f-9de59d5e9cf6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/ips" status: 200 len: 150 microversion: 2.1 time: 0.039111 Sep 07 19:22:48.634667 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 409/828] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:22:48 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:22:50.370219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d0a01e-6322-4bec-bb29-39f20828810f"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:50.372815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:22:50.379655 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:50.380138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:50.380573 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:50.381266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:22:50.381721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:22:50.382149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:22:51.155758 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-04061893-468c-4fba-a96a-14331762af8a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789689 Sep 07 19:22:51.156404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 420/829] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:22:50 2022] POST /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:22:58.685641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-848e4ff2-0b2c-420f-be62-d33c16827e48 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: .version_select at 0x7ff4ddb70ca0>, body: {"keypair": {"name": "tempest-keypair-245647112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLD1KxG73ji3+cX4lOqtKiWyuPsaFLhMy1v9Y1Gc91ZzURMyXkHwKLpiy43SPlsl3J8DxdOPUUajH1ctR3hRbVYa/9fxPI/HIMkCeSs7xezfNFpLvYNosHmQysTAi30zg=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:22:58.702225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-848e4ff2-0b2c-420f-be62-d33c16827e48 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:22:58.706807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-848e4ff2-0b2c-420f-be62-d33c16827e48 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:22:58.763875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-848e4ff2-0b2c-420f-be62-d33c16827e48 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.082881 Sep 07 19:22:58.764475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 410/830] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:22:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:23:00.867290 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1198169152", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53498e05-b723-4a63-83c7-f76293f9aace"}], "security_groups": [{"name": "tempest-securitygroup--1879586988"}], "key_name": "tempest-keypair-245647112", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:00.879073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:00.976954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] validate_networks() for [('53498e05-b723-4a63-83c7-f76293f9aace', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:23:01.067806 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:01.348317 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:23:01.348740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:23:01.349213 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:23:01.349620 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:23:01.350028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:23:01.358786 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:01.359265 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:01.359697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:01.360422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:01.360876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:01.361293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:01.379277 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:23:01.383222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:23:01.394012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:23:01.396378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:23:01.514017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-04a98d75-7929-40ea-862d-8b442e0d9629 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653067 Sep 07 19:23:01.514749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 421/831] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:23:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 19:23:01.527291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-61892e3e-041f-4f09-9544-ad34320dafff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:01.528008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-61892e3e-041f-4f09-9544-ad34320dafff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:01.581110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-61892e3e-041f-4f09-9544-ad34320dafff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:01.588846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-61892e3e-041f-4f09-9544-ad34320dafff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1241 microversion: 2.1 time: 0.066601 Sep 07 19:23:01.589443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 411/832] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:01 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:02.612478 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:02.613093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:02.619405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:02.619895 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:02.620332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:02.621022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:02.621865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:02.622397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:02.684791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:02.692959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7c9d2a0c-5408-4f3f-bfd5-e13ac3e91996 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1245 microversion: 2.1 time: 0.084891 Sep 07 19:23:02.693512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 422/833] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:02 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:03.715649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:03.721607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:03.723475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.723967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.724407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.725106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.725572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.726000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.786020 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:03.788341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:03.793906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:03.795774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.795774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.796048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.796856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.797306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.797725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.801950 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f1fcb6e-f63d-4c21-acae-d54dc5725db6 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1245 microversion: 2.1 time: 0.090278 Sep 07 19:23:03.802629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 412/834] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:03 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:03.827523 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f19f2021-c318-4b08-bb45-9f2dc64d2676 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046665 Sep 07 19:23:03.828073 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 423/835] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:23:03 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 19:23:03.895120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:03.895619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:03.901641 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.902387 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.902860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.911313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:03.911313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:03.911313 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:03.932761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:23:04.283089 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cbdb130d-a273-469a-83bf-c465d549e635 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 204 len: 0 microversion: 2.1 time: 0.392152 Sep 07 19:23:04.283686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 413/836] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:23:03 2022] DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:23:04.291799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:04.292585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:04.301517 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:04.302002 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:04.302496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:04.303226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:04.303683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:04.304113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:04.432612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:04.440925 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c596aa47-14ef-4696-a6b0-8136eadaf508 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1673 microversion: 2.1 time: 0.152961 Sep 07 19:23:04.441495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 424/837] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:04 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:04.825914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:04.826732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:04.833090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:04.833556 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:04.833992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:04.834726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:04.835181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:04.835603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:04.904176 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:04.912778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27a24ba9-e527-4235-8bcd-95fed64acf3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1293 microversion: 2.1 time: 0.091119 Sep 07 19:23:04.913444 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 414/838] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:04 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:23:05.463659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:05.464412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:05.471186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:05.471841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:05.472346 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:05.473140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:05.473649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:05.474076 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:05.604546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:05.612390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f37d635d-8d52-49eb-9f30-13b8cf0f5c3b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1673 microversion: 2.1 time: 0.152697 Sep 07 19:23:05.612965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 425/839] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:05 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:05.951137 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:05.951679 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:05.958125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:05.958668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:05.959110 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:05.960016 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:05.960479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:05.960911 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:06.023216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:06.031057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4eeb5a3e-1867-47f0-9d99-9cce1f242798 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1293 microversion: 2.1 time: 0.083893 Sep 07 19:23:06.038735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 415/840] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:05 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:06.636062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:06.636676 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:06.645220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:06.645707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:06.646146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:06.646882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:06.647341 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:06.647772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:06.774222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:06.782287 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9c46165d-1750-4cb0-b4af-9a513a39d2fe tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1673 microversion: 2.1 time: 0.150029 Sep 07 19:23:06.783228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 426/841] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:06 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:07.053402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:07.054024 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:07.060517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:07.061073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:07.061579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:07.062365 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:07.062837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:07.063265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:07.129516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:07.137440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13f702c4-c5e1-42c8-b93b-cb206fd8fecc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1301 microversion: 2.1 time: 0.087871 Sep 07 19:23:07.138710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 416/842] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:07 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:07.806198 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:07.806761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:07.813596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:07.814097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:07.814542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:07.815348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:07.815808 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:07.816240 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:07.881801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:07.890173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6b935ed9-1181-40d8-9120-3a85c390bb20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1605 microversion: 2.1 time: 0.087916 Sep 07 19:23:07.890801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 427/843] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:07 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:08.161567 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:08.162226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:08.168602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.171001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.171001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.171001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.171001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.171363 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.242615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:08.250720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-e9e57ef9-a647-44e1-805d-ed71968cafb7 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1299 microversion: 2.1 time: 0.092966 Sep 07 19:23:08.251376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 417/844] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:08 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:08.296217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00e0417-c632-48c2-86de-591aef7988a1", "name": "network-vif-deleted", "tag": "d5c936e5-3c24-493f-ae49-d62d605c57ab"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:08.306212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.306757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.307194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.319437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] Creating event network-vif-deleted:d5c936e5-3c24-493f-ae49-d62d605c57ab for instance e00e0417-c632-48c2-86de-591aef7988a1 on hv-cinder-84773 Sep 07 19:23:08.324548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-db76886b-5de6-4ddd-8386-066f3eedeaa8 req-0d86619c-6983-45a6-aeac-4c628fd1dd98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032051 Sep 07 19:23:08.325159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 428/845] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:08.723943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1735856191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-290973285", "security_groups": [{"name": "tempest-secgroup-smoke-1301025987"}], "block_device_mapping_v2": [{"uuid": "2f8f1fdc-e5d7-4dd3-aeb7-7b982aa4a0b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7907def-f826-42d8-850a-2135619ed42f"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:08.903977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] validate_networks() for [('a7907def-f826-42d8-850a-2135619ed42f', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:23:08.916424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:08.917129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:08.924490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.925243 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.926048 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.927021 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.927634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.928312 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.979675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:08.980453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:08.981044 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:08.981651 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lazy-loading 'fault' on Instance uuid e00e0417-c632-48c2-86de-591aef7988a1 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:23:09.063119 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:09.073779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3b554575-66bc-4858-a195-c214d96fcd15 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 200 len: 1327 microversion: 2.1 time: 0.161591 Sep 07 19:23:09.074271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 429/846] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:08 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:09.275185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:09.276206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:09.282731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:09.283746 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:09.284241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:09.284996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:09.285451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:09.286033 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:09.485642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:23:09.487035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:23:09.492813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:23:09.492813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:23:09.492813 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:23:09.499354 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:09.500099 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:09.500824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:09.501726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:09.502206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:09.505352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:09.510431 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:09.521671 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ea0a8bd4-00a3-4deb-a35e-969e9f0bc412 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.249385 Sep 07 19:23:09.521774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 430/847] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:09 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:09.530357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:23:09.535345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Getting quotas for user f9db5f73350c460f99e4ab5cdbe6907a and project 7847d148d828478b8124c8d08c8c582f. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:23:09.595143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:23:09.597951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f8f1fdc-e5d7-4dd3-aeb7-7b982aa4a0b0',volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:23:10.050857 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ee06f154-3b64-4162-981b-0a2fbe9a9f1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.333416 Sep 07 19:23:10.051908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 418/848] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:23:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:23:10.062890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f1ddbf71-b9d5-468a-bf8f-09c664f70af9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:10.063617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f1ddbf71-b9d5-468a-bf8f-09c664f70af9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:10.097811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:10.098724 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:10.105949 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:10.106441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:10.106906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:10.107613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:10.108247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:10.108676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:10.129290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:23:10.134497 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f1ddbf71-b9d5-468a-bf8f-09c664f70af9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 HTTP/1.1 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:23:10.135704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:23:10.137471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'e00e0417-c632-48c2-86de-591aef7988a1'} Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:23:10.138326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:23:10.139695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:23:10.140963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:23:10.140963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0676b110-2d0e-4ec1-8023-fa80422a59ca tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 404 len: 111 microversion: 2.1 time: 0.043535 Sep 07 19:23:10.140963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 419/849] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:10 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:23:10.144433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f1ddbf71-b9d5-468a-bf8f-09c664f70af9 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1094 microversion: 2.1 time: 0.085499 Sep 07 19:23:10.146329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 431/850] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:10 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:10.148041 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-208342c5-1591-48a9-bd11-b4be432c1603 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '.version_select at 0x7ff4ddac2160>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:10.249573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-208342c5-1591-48a9-bd11-b4be432c1603 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781901917" status: 202 len: 0 microversion: 2.1 time: 0.106560 Sep 07 19:23:10.250153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 420/851] 10.222.0.46 () {58 vars in 1221 bytes} [Wed Sep 7 19:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781901917 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:23:10.345526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bcc47db-c9f4-43e3-9418-09d96e93e0dc", "tag": "a32f9ee8-c280-4488-b633-582363a67f9b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:10.355892 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:10.356375 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:10.356799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:10.367988 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] Creating event network-changed:a32f9ee8-c280-4488-b633-582363a67f9b for instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc on hv-cinder-84773 Sep 07 19:23:10.372805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-8c926e15-d948-4376-8c2a-4157e10a64df req-17fdf519-c5b7-4b3a-8336-d321d64403f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031911 Sep 07 19:23:10.373403 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 432/852] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:23:10.545291 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:10.546525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:10.556077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:10.556569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:10.557007 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:10.557716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:10.558171 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:10.558620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:10.772574 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:10.780860 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a27874f9-1c78-40c7-8995-d486b83b7a78 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.239341 Sep 07 19:23:10.781442 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 421/853] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:10 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:11.148741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-56058b5b-e90d-42d9-9241-8e2ee2788e20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: .version_select at 0x7ff4da0da550>, body: {"keypair": {"name": "tempest-keypair-630548133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Li2MZtVGsbXfSFw753yGceG0oIAo+3QXJP2QMDuNRue+KCoXUi5KDO2aaQYgUEOVrIPv8qgA5rzlGbhFXns/GQWvKRN6WhRDFLe6WG5XeHk5X1olqd8LVYZZnozwA2A=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:11.164965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-56058b5b-e90d-42d9-9241-8e2ee2788e20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for project 53d22963975b4bb891b1858f4afe3275. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:23:11.168671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:11.174478 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-56058b5b-e90d-42d9-9241-8e2ee2788e20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for user 7c8142614fe149fd9593cfba97ecad18 and project 53d22963975b4bb891b1858f4afe3275. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:23:11.174666 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:11.176902 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:11.177515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:11.178141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:11.179716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:11.180277 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:11.181548 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:11.248523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:11.251207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-56058b5b-e90d-42d9-9241-8e2ee2788e20 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107005 Sep 07 19:23:11.253300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 433/854] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:23:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:11.258093 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0f4a39ce-d38a-4a9f-8794-02f22f68db2f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1144 microversion: 2.1 time: 0.093609 Sep 07 19:23:11.260788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 422/855] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:11 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:11.805138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:11.805887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:11.807882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:11.812837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:11.813324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:11.813760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:11.814511 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:11.815519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:11.815944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:11.971034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:11.978769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e951d7a5-1709-494b-9391-71e6302429f8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.177641 Sep 07 19:23:11.979338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 434/856] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:11 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:12.281982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:12.282625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:12.289977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:12.290448 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:12.290953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:12.291655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:12.292210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:12.292575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:12.358453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:12.368311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7bb21440-21da-413c-9823-3ed698a0a621 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1200 microversion: 2.1 time: 0.090410 Sep 07 19:23:12.368885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 423/857] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:12 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:13.001078 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:13.001699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:13.008989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:13.009484 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:13.009924 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:13.010658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:13.011159 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:13.011993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:13.152463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:13.162248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d1a27ea8-457e-4b23-8f2d-5af13af6f52c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.165024 Sep 07 19:23:13.168621 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 435/858] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:12 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:13.391490 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:13.393129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:13.400573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:13.401346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:13.402096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:13.402910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:13.403441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:13.403924 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:13.568603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:13.575523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-60a14d3e-bd92-4010-ab77-615c93c8121a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1278 microversion: 2.1 time: 0.188298 Sep 07 19:23:13.577808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 424/859] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:13 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:14.066182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-717299544", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f83fe1e5-d2ef-4bfd-98be-375651cb2f45"}], "security_groups": [{"name": "tempest-securitygroup--1563347213"}], "key_name": "tempest-keypair-630548133", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:14.170772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] validate_networks() for [('f83fe1e5-d2ef-4bfd-98be-375651cb2f45', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:23:14.185293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:14.186183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:14.192779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.193327 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.193838 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.194613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.195214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.195695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.409591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:14.417760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-af9ac716-9fa9-41b8-9824-de95a999d235 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.236079 Sep 07 19:23:14.418960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 425/860] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:14 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:23:14.604956 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:14.605668 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:14.620015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.620608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.620862 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:23:14.621267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.621486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:23:14.621966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:23:14.622201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.622378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:23:14.623324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.623653 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:23:14.624069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.633347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.634033 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.637395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.637395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.637395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.637395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.653565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for project 53d22963975b4bb891b1858f4afe3275. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:23:14.658028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Getting quotas for user 7c8142614fe149fd9593cfba97ecad18 and project 53d22963975b4bb891b1858f4afe3275. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:23:14.670037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:23:14.672361 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:23:14.764364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:14.772830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8ac9b051-ebfa-4f63-b5cf-287719133264 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.172457 Sep 07 19:23:14.773439 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 426/861] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:14 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:14.778113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4607a2cb-414f-4b4c-97d2-e16b4b51f22c", "tag": "59d0c88d-b4cc-4c21-8996-74e964b424d2"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:14.787982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:14.788453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:14.788892 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:14.802008 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] Creating event network-changed:59d0c88d-b4cc-4c21-8996-74e964b424d2 for instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c on hv-cinder-84773 Sep 07 19:23:14.806903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-92d9aa5a-6c5b-4444-ba49-794d611914af req-74e56009-a223-44e4-a740-d1f8b09121c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032317 Sep 07 19:23:14.807508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 427/862] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:14.812278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-926e9e31-b00b-4ebc-865d-e72e1d2a7b30 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.750960 Sep 07 19:23:14.818244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 436/863] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:23:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:23:14.829030 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ae5f8c64-8ea9-4592-9233-d766838c3610 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:14.829748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ae5f8c64-8ea9-4592-9233-d766838c3610 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:14.887716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ae5f8c64-8ea9-4592-9233-d766838c3610 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:14.895007 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ae5f8c64-8ea9-4592-9233-d766838c3610 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1236 microversion: 2.1 time: 0.070692 Sep 07 19:23:14.895580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 428/864] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:14 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:15.441099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:15.441791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:15.448478 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.448958 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.449390 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.450079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.450524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.450975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.581125 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:15.589393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ce4db6d6-b73c-4a35-b380-3f03ae91d9b3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.152321 Sep 07 19:23:15.590080 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 437/865] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:15 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:15.691249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcc47db-c9f4-43e3-9418-09d96e93e0dc", "name": "network-vif-plugged", "status": "completed", "tag": "a32f9ee8-c280-4488-b633-582363a67f9b"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:15.702793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.703270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.703694 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.714379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] Creating event network-vif-plugged:a32f9ee8-c280-4488-b633-582363a67f9b for instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc on hv-cinder-84773 Sep 07 19:23:15.719124 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-41371a2c-7453-4f45-9fd1-05624da78cd8 req-db7415bb-aca3-4873-adf5-92b768dab87e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031750 Sep 07 19:23:15.720019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 429/866] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:15.796995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:15.807349 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:15.829154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.829658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.830658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.831584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.832218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.832679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.921858 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:15.923191 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:15.929931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.930421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.931018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.931734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:15.932182 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:15.932617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:15.979123 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:15.989530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2c54a05d-5e0d-4e71-893f-3b100a397812 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.196132 Sep 07 19:23:15.990379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 438/867] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:15 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:16.031417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:16.037821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:16.042558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2f8258e4-a1e1-45dc-8216-4e8679066854 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1240 microversion: 2.1 time: 0.125142 Sep 07 19:23:16.043155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 430/868] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:15 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1240 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:23:16.612232 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:16.612879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:16.619351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:16.619837 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:16.620269 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:16.620963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:16.621412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:16.621842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:16.753417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:16.761019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1aede974-7323-42f9-81b3-61e344fe9e45 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1367 microversion: 2.1 time: 0.152645 Sep 07 19:23:16.761579 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 439/869] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:16 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:17.013360 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:17.014017 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:17.020875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.021353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.021789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.022480 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.022963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.023382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.065569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:17.066187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:17.076373 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.076872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.077309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.078022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.078656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.079095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.161141 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:17.169019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f4c8e001-7e09-44dc-a177-8f3b2b83b60b tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1288 microversion: 2.1 time: 0.107808 Sep 07 19:23:17.169592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 440/870] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:17 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:23:17.451605 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:17.459251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3c3b2164-a3d5-420f-9363-5fda37c17825 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.450037 Sep 07 19:23:17.459814 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 431/871] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:17 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:17.785019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:17.785622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:17.791927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.792404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.792839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.793527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.793981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.794582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.923897 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:17.927360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=100 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:17.932595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-700e606e-5504-4e56-811e-1bb2dd895c30 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1558 microversion: 2.1 time: 0.151512 Sep 07 19:23:17.932807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 441/872] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:17 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:17.954611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:17.963921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:17.963921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.963921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.963921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:17.964323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:17.964323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:17.964323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:18.043404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dc8e0f0a-ac19-4c3d-b41e-a0f4923231db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092720 Sep 07 19:23:18.044011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 432/873] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:23:17 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:18.193665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:18.194279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:18.200458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:18.200946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:18.201379 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:18.202101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:18.202779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:18.203203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:18.270261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:18.278685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8756503c-687b-491b-870c-b057b9d79818 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1296 microversion: 2.1 time: 0.089766 Sep 07 19:23:18.279487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 442/874] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:18 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:18.482358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:18.483236 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:18.490035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:18.490647 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:18.491142 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:18.491899 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:18.492413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:18.492829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:18.627141 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:18.634897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-89e0efa0-6152-40a5-bea6-ab6c38ea88c3 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.156456 Sep 07 19:23:18.635460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 433/875] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:18 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:19.301859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:19.302614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:19.310152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:19.310590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:19.311034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:19.311740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:19.312204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:19.312669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:19.374263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:19.382683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9fd743b7-4adf-4aaa-9f7c-44ccece2ed3d tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1294 microversion: 2.1 time: 0.085275 Sep 07 19:23:19.383348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 443/876] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:19 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:19.452078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bcc47db-c9f4-43e3-9418-09d96e93e0dc", "tag": "a32f9ee8-c280-4488-b633-582363a67f9b"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:19.462762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:19.463328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:19.463848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:19.476057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] Creating event network-changed:a32f9ee8-c280-4488-b633-582363a67f9b for instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc on hv-cinder-84773 Sep 07 19:23:19.481210 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1abbabd7-a343-45b4-9dbd-6d7f38cf92e6 req-57978c75-8a7c-4329-b524-1e32d0ce86e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032693 Sep 07 19:23:19.482104 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 434/877] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:19.657853 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:19.659030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:19.665264 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:19.665759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:19.675008 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:19.676083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:19.676674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:19.677585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:19.825275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:19.835385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-27019a88-c32b-4ed6-bee7-83d01ab8cbe0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.181012 Sep 07 19:23:19.836656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 444/878] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:19 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:20.402889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:20.407234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:20.408098 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:20.415789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:20.415789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:20.415789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:20.416712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:20.416712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:20.416990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:20.554713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:20.563572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85f672fe-26f9-4242-a0a0-387d4dcd8e62 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.161682 Sep 07 19:23:20.564984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 435/879] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:20 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:20.859548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:20.860174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:20.867228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:20.867717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:20.868157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:20.868893 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:20.869350 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:20.869775 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:21.003420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:21.011152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e4bef4c4-b923-4015-8d3b-417850ad1507 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.155736 Sep 07 19:23:21.011712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 445/880] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:20 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:21.502572 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ee899e-995d-4fd9-bf83-af9a5ee92c6d", "tag": "70f48355-5235-4d9c-a5fa-78acc45e98ec"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:21.512257 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:21.512737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:21.513279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:21.524145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] Creating event network-changed:70f48355-5235-4d9c-a5fa-78acc45e98ec for instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d on hv-cinder-84773 Sep 07 19:23:21.529238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-528f029c-ada2-472c-acec-11406bd24fc8 req-f481a0a4-f1af-46e5-be0d-7406c656150a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031016 Sep 07 19:23:21.530154 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 436/881] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:21.587329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:21.588027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:21.593994 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:21.594583 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:21.595090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:21.596495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:21.597010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:21.597501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:21.725272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:21.732873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e0ad4d2-a495-44ed-9001-9a87a81958a3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.149541 Sep 07 19:23:21.733460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 446/882] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:21 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:22.034710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:22.035381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:22.041623 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:22.042108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:22.042544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:22.043271 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:22.043728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:22.044151 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:22.176464 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:22.184879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5fda6a70-4b0d-4a22-84d9-f66496d18b48 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.155045 Sep 07 19:23:22.185458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 437/883] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:22 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:22.755900 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:22.756507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:22.759879 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:22.769868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:22.769868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:22.769868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:22.769868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:22.770460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:22.770460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:22.899686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:22.907729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f44fd33e-5bc3-4011-8a52-2edeb4db8150 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.155762 Sep 07 19:23:22.908939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 447/884] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:22 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:23.209792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:23.210586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:23.221942 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:23.222445 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:23.223737 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:23.223945 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:23.225014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:23.225867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:23.357396 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:23.365078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4ee06c9b-e80f-4683-96ef-992d279657fb tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.160904 Sep 07 19:23:23.365652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 438/885] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:23 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:23.931006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:23.931685 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:23.937945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:23.938424 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:23.938887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:23.940219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:23.940665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:23.941084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:24.074584 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:24.080646 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a4e7ef92-7d03-454c-b77d-3ea6c2def734 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.153482 Sep 07 19:23:24.081236 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 448/886] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:23 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:24.388161 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:24.388792 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:24.392324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:24.395676 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:24.396162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:24.396595 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:24.397286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:24.397742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:24.398259 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:24.528649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:24.536963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5e37cbf5-12df-44a6-92cf-c7a6ed9cfeed tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.152690 Sep 07 19:23:24.537524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 439/887] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:24 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:25.104241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:25.104856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:25.106725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:25.107437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=18 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:25.112930 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:25.113419 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:25.113857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:25.114626 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:25.115086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:25.115514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:25.247187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:25.255413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a8181aa3-c762-48d7-8b47-f19f2c2ed856 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.155063 Sep 07 19:23:25.255985 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 449/888] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:25 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:25.559436 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:25.560155 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:25.562035 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=14 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:23:25.568474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:25.568966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:25.569403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:25.570181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:25.570696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:25.574745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:25.711090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:25.719786 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c16834f6-ea21-4c7d-8c73-7ec4e8be7d8f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.164216 Sep 07 19:23:25.720358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 440/889] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:25 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:25.968083 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4607a2cb-414f-4b4c-97d2-e16b4b51f22c", "name": "network-vif-plugged", "status": "completed", "tag": "59d0c88d-b4cc-4c21-8996-74e964b424d2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:25.977656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:25.978136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:25.978594 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:25.989942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] Creating event network-vif-plugged:59d0c88d-b4cc-4c21-8996-74e964b424d2 for instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c on hv-cinder-84773 Sep 07 19:23:25.995052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-0531dd11-e395-4d56-8f5d-70fd8f0c84b8 req-5e0e3ba9-c34d-41cd-9115-fd62d5ea3e8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Sep 07 19:23:25.996028 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 450/890] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:23:26.277900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:26.278621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:26.285166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:26.285731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:26.286158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:26.286889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:26.287348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:26.287776 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:26.432807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:26.440407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-06bdadbb-2767-4a58-8ee3-1e69f710fd31 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.166733 Sep 07 19:23:26.440969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 441/891] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:26 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:26.743092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:26.743800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:26.749895 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:26.750381 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:26.750842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:26.751533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:26.751989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:26.752429 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:26.891997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:26.900126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4b3c49cc-21be-4a11-b2dd-6c9af6c8ac0f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1266 microversion: 2.1 time: 0.161703 Sep 07 19:23:26.900697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 451/892] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:26 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:27.463421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:27.464044 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:27.470604 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:27.471090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:27.471538 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:27.472225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:27.472681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:27.473108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:27.606921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:27.615527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-66b99028-af0f-46e0-a214-a86b8aad7dba tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.155900 Sep 07 19:23:27.618602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 442/893] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:27 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:27.923489 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:27.924119 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:27.931468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:27.933318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:27.933318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:27.933318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:27.933641 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:27.933944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.010252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ee899e-995d-4fd9-bf83-af9a5ee92c6d", "name": "network-vif-plugged", "status": "completed", "tag": "70f48355-5235-4d9c-a5fa-78acc45e98ec"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:28.019565 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:28.020053 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:28.020479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.031895 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] Creating event network-vif-plugged:70f48355-5235-4d9c-a5fa-78acc45e98ec for instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d on hv-cinder-84773 Sep 07 19:23:28.037322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-31553dca-59d9-44d9-a526-76efdc84c547 req-cb1c94ef-abcf-4fee-8bd2-4388ee1f6bc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030606 Sep 07 19:23:28.037915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 443/894] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:23:28.066888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:28.074795 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-516f52de-3ca0-4e1a-8f6a-f5bc86d99a0c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1453 microversion: 2.1 time: 0.155151 Sep 07 19:23:28.075374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 452/895] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:27 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:28.099420 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:28.100044 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:28.106359 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:28.106885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:28.107349 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.108067 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:28.108530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:28.109116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.248693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:28.256439 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-40790026-eb7b-4bdd-a181-1e129f8f2ce0 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1453 microversion: 2.1 time: 0.162002 Sep 07 19:23:28.257000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 444/896] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:28 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:28.639106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:28.639627 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:28.645649 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:28.646139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:28.646575 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.647317 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:28.647768 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:28.648190 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:28.810707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:28.818174 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4cbeb4e4-e523-4b04-8bb1-d4b62f567047 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.182995 Sep 07 19:23:28.818765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 453/897] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:28 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:29.840751 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:29.841366 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:29.848106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:29.848586 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:29.849018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:29.849707 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:29.850156 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:29.850598 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:30.189874 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:30.198430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-31d7c590-615a-4ab9-b894-75762f42c777 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1362 microversion: 2.1 time: 0.361520 Sep 07 19:23:30.199267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 445/898] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:29 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:30.299444 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4607a2cb-414f-4b4c-97d2-e16b4b51f22c", "tag": "59d0c88d-b4cc-4c21-8996-74e964b424d2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:30.310512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:30.311074 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:30.311655 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:30.323320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] Creating event network-changed:59d0c88d-b4cc-4c21-8996-74e964b424d2 for instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c on hv-cinder-84773 Sep 07 19:23:30.328105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-9c0921e4-f406-4f28-a564-7d1963c477ec req-f1403592-0c80-4717-94f0-b6cd71b51669 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032365 Sep 07 19:23:30.328873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 454/899] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:31.221302 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:31.221877 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:31.228382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:31.228901 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:31.229335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:31.230022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:31.230476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:31.230926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:31.360791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:23:31.368891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d87cc5b0-1d09-40f6-b378-1d484b039b78 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1547 microversion: 2.1 time: 0.151545 Sep 07 19:23:31.369451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 446/900] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:23:31 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:23:31.392947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:23:31.394038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:23:31.400128 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:31.400605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:31.401035 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:31.402640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:31.403096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:31.403518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:31.481063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d0c843af-3708-4dc3-bd2a-d93e0a4af2a7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092858 Sep 07 19:23:31.481657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 455/901] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:23:31 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:23:32.713551 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ee899e-995d-4fd9-bf83-af9a5ee92c6d", "tag": "70f48355-5235-4d9c-a5fa-78acc45e98ec"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:23:32.723542 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:23:32.724106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:23:32.724612 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:23:32.735713 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] Creating event network-changed:70f48355-5235-4d9c-a5fa-78acc45e98ec for instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d on hv-cinder-84773 Sep 07 19:23:32.741431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-07e52c21-d5d4-4f57-9ae8-6d541c57524b req-79caafb5-6df5-4314-8fc4-2f3061f49b64 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031364 Sep 07 19:23:32.742015 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 447/902] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:03.342387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=16 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:03.343166 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=74 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:03.346974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:03.347461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:03.353245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.354467 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.354467 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.354904 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.355286 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.355707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.378665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-82aee71c-059b-4309-b02e-96767ccf57ee tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/ips" status: 200 len: 151 microversion: 2.1 time: 0.037911 Sep 07 19:24:03.379247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 456/903] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:24:03 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:03.392111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d0a01e-6322-4bec-bb29-39f20828810f"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:03.394525 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:03.397162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=16 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:03.397807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=84 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:03.403207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.403701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.404134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.404833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.405283 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.405702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.483230 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/os-volume_attachments HTTP/1.1 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 74 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:24:03.484986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {"volumeAttachment": {"volumeId": "b9d0a01e-6322-4bec-bb29-39f20828810f"}} Sep 07 19:24:03.486748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '8bcc47db-c9f4-43e3-9418-09d96e93e0dc', 'body': {'volumeAttachment': {'volumeId': 'b9d0a01e-6322-4bec-bb29-39f20828810f'}}} Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:03.487779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:03.489292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 400 to user: Invalid volume: volume b9d0a01e-6322-4bec-bb29-39f20828810f is already attached to instances: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2209ef24-2670-4d5e-96b1-e84b9096b7c4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098851 Sep 07 19:24:03.491423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 448/904] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:24:03 2022] POST /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 19:24:03.496145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:03.496630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:03.502847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.503324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.503751 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.504436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.504915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.505335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.529866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:24:03.755989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-32cd2da4-e876-4ddd-9d69-4ee3d9e4b63d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 204 len: 0 microversion: 2.1 time: 0.263809 Sep 07 19:24:03.756539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 457/905] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:24:03 2022] DELETE /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:24:03.764729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:03.765430 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:03.771443 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.771929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.772364 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.773052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:03.773507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:03.773929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:03.901194 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:03.909130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b8e6cf65-8867-42f6-a3b1-825f3c548557 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1683 microversion: 2.1 time: 0.148421 Sep 07 19:24:03.909696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 449/906] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:03 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:04.933878 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:04.934599 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:04.941067 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:04.941551 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:04.941989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:04.942718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:04.943182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:04.944239 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:05.072495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:05.080367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0a18aba0-134b-4dc2-b52d-7fc4784d7773 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1683 microversion: 2.1 time: 0.150732 Sep 07 19:24:05.080941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 458/907] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:04 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:06.104872 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:06.105793 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:06.112456 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:06.113043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:06.113561 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:06.114351 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:06.114923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:06.116166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:06.179815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:06.187779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-28c35470-5ea9-4948-ae9f-cff35cb7e8bc tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1615 microversion: 2.1 time: 0.088498 Sep 07 19:24:06.188339 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 450/908] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:06 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1615 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:06.288266 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bcc47db-c9f4-43e3-9418-09d96e93e0dc", "name": "network-vif-deleted", "tag": "a32f9ee8-c280-4488-b633-582363a67f9b"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:06.298974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:06.299450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:06.300077 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:06.311448 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] Creating event network-vif-deleted:a32f9ee8-c280-4488-b633-582363a67f9b for instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc on hv-cinder-84773 Sep 07 19:24:06.316427 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-52764700-207e-4d81-b0a0-50c63e12371c req-d6db08e5-5f42-48d6-b180-dbb39443790f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032380 Sep 07 19:24:06.317015 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 459/909] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:07.218903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:07.219511 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:07.227323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:07.227809 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:07.228237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:07.228928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:07.229380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:07.229797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:07.274459 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:07.275323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:07.275826 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:07.276423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'fault' on Instance uuid 8bcc47db-c9f4-43e3-9418-09d96e93e0dc {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:24:07.317851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:07.326294 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-892944c7-c33e-4ca4-aa7a-9bf068c69a36 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 200 len: 1331 microversion: 2.1 time: 0.119442 Sep 07 19:24:07.333746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 451/910] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:07 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:08.350386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:08.351119 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:08.357154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:08.357633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:08.358058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:08.358769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:08.359215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:08.359633 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:08.372395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc HTTP/1.1 Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:24:08.373973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:24:08.375567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '8bcc47db-c9f4-43e3-9418-09d96e93e0dc'} Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:08.376555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:24:08.377864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:08.379148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:08.379148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-85357be0-7a88-4b36-b59c-6ec6d9a13681 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 404 len: 111 microversion: 2.1 time: 0.029577 Sep 07 19:24:08.379148 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 460/911] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:08 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:08.384374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-613042d2-53f8-4676-ac34-9eec1620c133 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '.version_select at 0x7ff4ddb60940>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:08.454330 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-613042d2-53f8-4676-ac34-9eec1620c133 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245647112" status: 202 len: 0 microversion: 2.1 time: 0.074119 Sep 07 19:24:08.454918 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 452/912] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Sep 7 19:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245647112 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:24:08.814875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:08.815299 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:08.821792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:08.822286 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:08.822759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:08.823485 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:08.823947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:08.824369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:08.847747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f06ad803-d6fa-41f9-80cd-99fcfd8bb257 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/ips" status: 200 len: 145 microversion: 2.1 time: 0.037157 Sep 07 19:24:08.848324 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 461/913] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:24:08 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:09.298381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:09.298933 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:09.305411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:09.306655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:09.306655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:09.307077 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:09.307534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:09.307967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:09.393279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'services' on Instance uuid 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:24:09.597718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-95907ac5-7b2d-496a-93b4-8eb814cbad98 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments/b9d0a01e-6322-4bec-bb29-39f20828810f" status: 202 len: 0 microversion: 2.1 time: 0.301126 Sep 07 19:24:09.597718 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 453/914] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:24:09 2022] DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments/b9d0a01e-6322-4bec-bb29-39f20828810f => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:24:09.605422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:09.607634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:09.613975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:09.614461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:09.614953 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:09.615683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:09.616136 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:09.616562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:09.645142 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2251adc8-65b8-4c54-9750-a0ea808c0a8f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Sep 07 19:24:09.645696 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 462/915] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:09 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:10.480186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:10.482684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:10.488897 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:10.489329 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:10.489787 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:10.490477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:10.490957 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:10.491382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:10.659006 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:10.661949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:10.668323 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:10.668810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:10.669247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:10.669945 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:10.670396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:10.670861 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:10.700196 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7266576a-b2fd-49d3-b1c4-b1662ef4bf9c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Sep 07 19:24:10.700750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 463/916] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:10 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:11.199865 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-dcc14e9c-3322-46de-9fa2-f39987bde38f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724268 Sep 07 19:24:11.200473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 454/917] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:24:10 2022] POST /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:11.712708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:11.715172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:11.723866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:11.724358 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:11.724800 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:11.725537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:11.726113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:11.726569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:11.755817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a118325a-c5e4-43a9-b1fb-73fbd915007f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047124 Sep 07 19:24:11.757045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 464/918] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:11 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:24:11.821832 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:11.822418 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:11.828589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:11.829072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:11.829509 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:11.830201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:11.830687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:11.831112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:11.855607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:24:12.139063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-45595a22-c049-4dc6-8994-a16fbd07adb0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 204 len: 0 microversion: 2.1 time: 0.322344 Sep 07 19:24:12.139658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 455/919] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:24:11 2022] DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:24:12.147665 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:12.148277 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:12.154385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:12.154908 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:12.155332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:12.156019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:12.156475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:12.156905 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:12.290029 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:12.297990 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-61581791-2311-4488-982e-81efb9c715db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1682 microversion: 2.1 time: 0.154128 Sep 07 19:24:12.298589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 465/920] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:12 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:13.322472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:13.323272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:13.329746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:13.330236 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:13.330697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:13.331506 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:13.331954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:13.332382 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:13.465431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:13.473282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0411d620-a707-4323-9904-3f2f86f2ec93 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1682 microversion: 2.1 time: 0.155769 Sep 07 19:24:13.473840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 456/921] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:13 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:14.496979 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:14.497574 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:14.504494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:14.504977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:14.505405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:14.506102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:14.507063 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:14.507481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:14.644215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:14.650617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9fd8f641-bdd9-46a1-b58e-6b08f790b78a tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1682 microversion: 2.1 time: 0.157480 Sep 07 19:24:14.651276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 466/922] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:14 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:15.128643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5", "name": "network-vif-deleted", "tag": "b552e47b-69b2-4250-abb7-42139cc3a4d6"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:15.138580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:15.139069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:15.139507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:15.151400 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] Creating event network-vif-deleted:b552e47b-69b2-4250-abb7-42139cc3a4d6 for instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 on hv-cinder-84773 Sep 07 19:24:15.156569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e9e6e479-c9ff-4252-9791-8364de3230d1 req-3e63b15e-fb94-4dca-b468-4d3b9f39eab3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Sep 07 19:24:15.157159 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 457/923] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:15.674515 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:15.675494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:15.682693 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:15.683245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:15.683741 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:15.684500 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:15.685010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:15.685565 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:15.716770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:15.717242 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:15.717673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:15.718110 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'fault' on Instance uuid 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:24:15.759956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:15.767747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fd7ef26c-dfa6-4f96-bbaf-4403269a06f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 200 len: 1331 microversion: 2.1 time: 0.097373 Sep 07 19:24:15.768318 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 467/924] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:15 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:16.793078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:16.793690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:16.799777 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:16.800252 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:16.800677 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:16.801353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:16.801799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:16.802211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:16.816982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 HTTP/1.1 Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:24:16.818582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:24:16.820134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5'} Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:16.821037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:24:16.822524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:16.823869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:16.823869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3b72a503-3f1d-4081-99c3-43cd89b44bd2 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 404 len: 111 microversion: 2.1 time: 0.032258 Sep 07 19:24:16.823869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 458/925] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:16 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:16.828629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b2cbba33-6bd8-4c3a-bf48-06c460f24f4f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '.version_select at 0x7ff4da14ff70>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:16.894271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b2cbba33-6bd8-4c3a-bf48-06c460f24f4f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941798447" status: 202 len: 0 microversion: 2.1 time: 0.069345 Sep 07 19:24:16.894888 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 468/926] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Sep 7 19:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941798447 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:24:17.612849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2c1d25dc-05d0-4114-bd84-6353a2e7010f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: .version_select at 0x7ff4ddbed8b0>, body: {"keypair": {"name": "tempest-keypair-487169992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3t9Qbco3xReQVedl+apnDdg1j1pdYQ/rn2NEkxuynrtjM8T84V7IGaX8DTP1gg4+TGjaxECybIS99h1hKyU8uQPWN7SjuM9UUfSVncXGKV1d7gvgtyMrg2AfO5b2twMQ=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:17.628388 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-2c1d25dc-05d0-4114-bd84-6353a2e7010f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:24:17.632816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-2c1d25dc-05d0-4114-bd84-6353a2e7010f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:24:17.717290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2c1d25dc-05d0-4114-bd84-6353a2e7010f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108170 Sep 07 19:24:17.717882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 459/927] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:24:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:19.745578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-745674423", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53498e05-b723-4a63-83c7-f76293f9aace"}], "security_groups": [{"name": "tempest-securitygroup--1182373016"}], "key_name": "tempest-keypair-487169992", "user_data": "}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:19.816094 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:19.819218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:19.826524 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:19.827038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:19.827478 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:19.828176 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:19.828881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:19.829306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:19.857110 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] validate_networks() for [('53498e05-b723-4a63-83c7-f76293f9aace', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:24:19.860042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6414be0f-dcb4-4c22-accf-24cca2a5f77e tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Sep 07 19:24:19.860638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 460/928] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:19 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:19.871850 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:19.872343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:19.878198 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:19.881849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:19.881849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:19.881849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:19.881849 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:19.882227 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:19.910722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-688cdb04-10fe-427f-b0c7-f3573b32087f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4" status: 200 len: 194 microversion: 2.1 time: 0.042547 Sep 07 19:24:19.916205 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 461/929] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Sep 7 19:24:19 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:20.236611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:24:20.237873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:24:20.238407 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:24:20.238857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:24:20.239271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:24:20.248146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:20.248622 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:20.249127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:20.249851 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:20.250302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:20.250757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:20.267688 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:24:20.272356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:24:20.283504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:24:20.285811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:24:20.410535 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-884a7608-54ac-48dd-9c8b-15f4f64a6bd4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669816 Sep 07 19:24:20.411226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 469/930] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:24:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:24:20.422498 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec908118-5a56-48b9-affa-7d6f9601b475 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:20.423270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec908118-5a56-48b9-affa-7d6f9601b475 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:20.479119 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec908118-5a56-48b9-affa-7d6f9601b475 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:20.487873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec908118-5a56-48b9-affa-7d6f9601b475 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1240 microversion: 2.1 time: 0.069351 Sep 07 19:24:20.488851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 462/931] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:20 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:21.510975 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:21.511544 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:21.517640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:21.518140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:21.520234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:21.520234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:21.520234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:21.520234 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:21.582839 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:21.588823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06655308-936f-4026-9a35-ab770173669e"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:21.591259 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:21.594507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d0c2775-cc59-4f7b-8704-124dc2d97c3e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1236 microversion: 2.1 time: 0.087686 Sep 07 19:24:21.595179 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 470/932] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:21 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:21.598799 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:21.599373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:21.600628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:21.601328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:21.601963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:21.602393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:22.180286 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:22.331930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-890f4c34-34e6-429a-ac9d-a6ba8104481c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "POST /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747340 Sep 07 19:24:22.332534 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 463/933] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:24:21 2022] POST /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 194 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:22.618182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:22.618831 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:22.625501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:22.625986 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:22.626640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:22.627822 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:22.628279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:22.628695 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:22.697519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:22.705305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2584684f-d150-46a2-97af-b07144d724c5 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1300 microversion: 2.1 time: 0.091906 Sep 07 19:24:22.705873 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 471/934] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:22 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:23.732915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:23.733650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:23.741032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:23.741521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:23.742121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:23.742868 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:23.743325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:23.743755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:23.872686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:23.880530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6f0f7459-b152-4ed2-a724-35c52df300ab tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.152552 Sep 07 19:24:23.881806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 464/935] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:23 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:24.103541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c73dc7b-fd01-42d6-863e-a56ca7d8a633", "tag": "340dfd15-c13e-4ef5-9236-6c10a631b2f1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:24.114283 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:24.114803 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:24.115237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:24.126443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] Creating event network-changed:340dfd15-c13e-4ef5-9236-6c10a631b2f1 for instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 on hv-cinder-84773 Sep 07 19:24:24.131916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-fa9d2dbf-82d9-4f92-95e1-c29ec4e96ce9 req-97d0458b-13f1-44e2-8f33-a0fa6d767813 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Sep 07 19:24:24.132523 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 472/936] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:24.904777 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:24.905444 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:24.911789 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:24.912772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:24.913204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:24.913890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:24.914341 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:24.914795 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:25.044204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:25.051788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbbe8ea6-516c-406c-819f-f6b601143f79 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.151183 Sep 07 19:24:25.052343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 465/937] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:24 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:26.075881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:26.076595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:26.082796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:26.083282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:26.083721 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:26.084466 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:26.084921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:26.085348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:26.225954 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:26.233674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-55bc4c3f-e19d-47ab-a675-231ae0ac835d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.162578 Sep 07 19:24:26.234244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 473/938] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:26 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:27.257076 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:27.257691 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:27.264211 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:27.264692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:27.265127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:27.265814 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:27.266265 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:27.266732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:27.392931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:27.401085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6847905f-a86a-47ae-9475-6d9d5bd90755 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.147947 Sep 07 19:24:27.401649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 466/939] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:27 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:28.429302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:28.429915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:28.437183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:28.437669 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:28.438109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:28.438833 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:28.439291 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:28.439714 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:28.573115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:28.576884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:28.581513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-2d58f61c-0cc7-4653-8660-b9ce756e9030 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.156718 Sep 07 19:24:28.582086 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 474/940] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:28 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:29.603879 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:29.604502 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:29.611027 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:29.611510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:29.611944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:29.612632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:29.613090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:29.613515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:29.743275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:29.750904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d70d9329-970f-4567-a936-dd82aa5fa8be tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.150867 Sep 07 19:24:29.751476 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 467/941] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:29 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:30.029097 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c73dc7b-fd01-42d6-863e-a56ca7d8a633", "name": "network-vif-plugged", "status": "completed", "tag": "340dfd15-c13e-4ef5-9236-6c10a631b2f1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:30.039688 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:30.040167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:30.040619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:30.051582 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] Creating event network-vif-plugged:340dfd15-c13e-4ef5-9236-6c10a631b2f1 for instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 on hv-cinder-84773 Sep 07 19:24:30.056744 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-8bb82896-3ec5-4635-9771-1f205a66afae req-4498abc7-3f2e-464c-b9bc-bd17f79d6619 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Sep 07 19:24:30.057404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 475/942] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:30.774095 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:30.774667 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:30.776638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:30.782082 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:30.782582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:30.786528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:30.786528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:30.786528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:30.786528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:30.936009 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:30.943910 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-cd8156aa-5eea-4b71-bbbe-d461f0c8cb88 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1366 microversion: 2.1 time: 0.173815 Sep 07 19:24:30.944558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 468/943] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:30 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:30.948518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:30.950754 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:30.952984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:30.953738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:30.959068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:30.959546 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:30.959977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:30.960663 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:30.961115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:30.961537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:30.992753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fbc4559e-0f82-42eb-8ac9-a6924659c286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048442 Sep 07 19:24:30.993308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 476/944] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:30 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:24:31.138284 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:31.138817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:31.144680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.145167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.145601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:31.146824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.147279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.147706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:31.176505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fd0213d1-b31e-4540-969c-b1f7bdc820b5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4" status: 200 len: 194 microversion: 2.1 time: 0.042273 Sep 07 19:24:31.177079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 469/945] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Sep 7 19:24:31 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:31.187738 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:31.188224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:31.195280 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.195766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.196202 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:31.196889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.197347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.197770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:31.278193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lazy-loading 'services' on Instance uuid d8ee899e-995d-4fd9-bf83-af9a5ee92c6d {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:24:31.451809 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-413b9b39-6087-40b1-8db6-41e0da8b17c3 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4" status: 202 len: 0 microversion: 2.1 time: 0.268171 Sep 07 19:24:31.452463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 477/946] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:24:31 2022] DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/36cdad1a-26f9-486e-bbdc-4d3bd85e3dc4 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:24:31.966460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:31.967111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:31.973541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.974021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.974473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:31.975176 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:31.975628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:31.976050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:32.110287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:32.118940 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-85f85eea-1c4c-4b38-842c-4283598b1c1b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1556 microversion: 2.1 time: 0.156337 Sep 07 19:24:32.119929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 470/947] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:31 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:32.142973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:32.143559 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:32.149819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:32.150301 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:32.150762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:32.151450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:32.151904 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:32.152590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:32.239605 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c7d7eca-d5a7-435f-9339-b1a030253118 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100838 Sep 07 19:24:32.240772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 478/948] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:24:32 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:33.232869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c73dc7b-fd01-42d6-863e-a56ca7d8a633", "tag": "340dfd15-c13e-4ef5-9236-6c10a631b2f1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:33.244657 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:33.245285 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:33.245915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:33.257665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] Creating event network-changed:340dfd15-c13e-4ef5-9236-6c10a631b2f1 for instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 on hv-cinder-84773 Sep 07 19:24:33.265934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1a5608b2-5cdd-40b1-b87b-3327b4998b52 req-d90aae1e-b01e-43fc-a6ce-143e74c5aba4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034923 Sep 07 19:24:33.265934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 471/949] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:33.634971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:33.635555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:33.638167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:33.643102 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:33.643675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:33.644180 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:33.644891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:33.645348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:33.645774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:33.684336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a53eecd3-0afd-4064-a52e-ec338e8db93a tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/06655308-936f-4026-9a35-ab770173669e" status: 200 len: 194 microversion: 2.1 time: 0.053396 Sep 07 19:24:33.684940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 479/950] 10.222.0.46 () {58 vars in 1413 bytes} [Wed Sep 7 19:24:33 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/06655308-936f-4026-9a35-ab770173669e => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:33.696629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:33.705130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:33.705130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:24:33.705130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:33.705130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:33.705521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:33.705955 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:33.706407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:33.707073 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:33.794133 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lazy-loading 'services' on Instance uuid d8ee899e-995d-4fd9-bf83-af9a5ee92c6d {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:24:34.041228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-981e2b56-ac7e-494a-8949-9312093cfc72 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/06655308-936f-4026-9a35-ab770173669e" status: 202 len: 0 microversion: 2.1 time: 0.349263 Sep 07 19:24:34.041815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 472/951] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:24:33 2022] DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments/06655308-936f-4026-9a35-ab770173669e => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:24:35.228105 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:35.230332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:35.237030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.238298 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.238778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.239486 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.240550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.240982 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.270647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e7ae3a30-8894-49d6-a073-c08706132bf9 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047467 Sep 07 19:24:35.271268 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 480/952] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:35 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:24:35.386855 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:35.389276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:35.395755 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.396243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.396686 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.397377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.397834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.398262 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.428526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-de5872da-c629-4858-9b7e-c79231affbf6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046535 Sep 07 19:24:35.429080 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 473/953] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:24:35 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:24:35.490913 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:35.491410 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:35.497701 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.498182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.498647 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.499337 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.499791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.500214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.526854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:24:35.773356 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-da319ed5-eeaa-4051-b627-2dbc310731ec tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 204 len: 0 microversion: 2.1 time: 0.286983 Sep 07 19:24:35.773941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 481/954] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:24:35 2022] DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:24:35.782536 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:35.783168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:35.789726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.790201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.790661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.791388 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:35.791834 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:35.792254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:35.920665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:35.928376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1068d56b-6f81-4c3d-ac08-16220fdbe2d7 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1672 microversion: 2.1 time: 0.149828 Sep 07 19:24:35.928936 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 474/955] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:35 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:24:36.952689 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:36.953402 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:36.960385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:36.960868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:36.961302 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:36.961990 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:36.962445 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:36.962894 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:37.094173 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:37.101808 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-87e22ab6-fc67-4201-b2e9-e66cd2b2dd09 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1672 microversion: 2.1 time: 0.153352 Sep 07 19:24:37.102393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 482/956] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:36 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:38.125840 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:38.126521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:38.134064 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:38.134570 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:38.135012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:38.135732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:38.136190 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:38.136621 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:38.276224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:38.284601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f329ffbf-58fc-4b9b-ba81-334f6b3e6286 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1672 microversion: 2.1 time: 0.162937 Sep 07 19:24:38.285188 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 475/957] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:38 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:39.103225 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ee899e-995d-4fd9-bf83-af9a5ee92c6d", "name": "network-vif-deleted", "tag": "70f48355-5235-4d9c-a5fa-78acc45e98ec"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:24:39.112787 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:39.113383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:39.113875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:39.127235 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] Creating event network-vif-deleted:70f48355-5235-4d9c-a5fa-78acc45e98ec for instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d on hv-cinder-84773 Sep 07 19:24:39.132805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-bb6416a1-a20d-4f0a-b873-a72f24979f35 req-6087b499-b09a-4d08-baa0-437655c38461 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033154 Sep 07 19:24:39.133541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 483/958] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:24:39.308650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:39.309272 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:39.317635 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:39.318901 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:39.323867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:39.323867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:39.323867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:39.323867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:39.383788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8142614fe149fd9593cfba97ecad18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d22963975b4bb891b1858f4afe3275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:24:39.391530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a9d92051-505e-4e26-b89a-7461e494a7f6 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 200 len: 1321 microversion: 2.1 time: 0.086881 Sep 07 19:24:39.394700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 476/959] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:39 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 1321 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:24:40.417092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:40.417724 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:40.423865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:40.424352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:40.424791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:40.425480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:40.425937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:40.426363 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:40.439274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d HTTP/1.1 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:24:40.440901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:40.442608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'd8ee899e-995d-4fd9-bf83-af9a5ee92c6d'} Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:40.444262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:40.445881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:40.447327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:40.447327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-91011cee-a41b-4706-af96-7522d5e9fc16 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 404 len: 111 microversion: 2.1 time: 0.030625 Sep 07 19:24:40.447327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 484/960] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:40 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:40.451986 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-06862396-6cf2-4a22-83b3-6a1ef6f2672f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '.version_select at 0x7ff4ddb18430>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:40.539889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-06862396-6cf2-4a22-83b3-6a1ef6f2672f tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630548133" status: 202 len: 0 microversion: 2.1 time: 0.091754 Sep 07 19:24:40.540478 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 477/961] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Sep 7 19:24:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630548133 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:24:43.693539 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:43.694040 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:43.700538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:43.701013 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:43.701459 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:43.702138 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:43.702609 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:43.703027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:43.715864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d HTTP/1.1 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:24:43.720260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.721978 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'd8ee899e-995d-4fd9-bf83-af9a5ee92c6d'} Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:43.722889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.724386 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.726463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:43.726463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-444015f2-cce6-4ab3-80e7-a00f37537bc5 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 404 len: 111 microversion: 2.1 time: 0.029037 Sep 07 19:24:43.726463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 485/962] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:24:43 2022] DELETE /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:43.728473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:43.729085 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: d8ee899e-995d-4fd9-bf83-af9a5ee92c6d] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:43.735812 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:43.736224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:43.736660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:43.737345 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:43.737790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:43.738206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:43.751791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d HTTP/1.1 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:24:43.753429 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.755160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'd8ee899e-995d-4fd9-bf83-af9a5ee92c6d'} Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:43.756113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. Sep 07 19:24:43.757625 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:43.759022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance d8ee899e-995d-4fd9-bf83-af9a5ee92c6d could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:43.759022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-bdc41ff6-d944-4962-8b26-d09ca066c41c tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d" status: 404 len: 111 microversion: 2.1 time: 0.031497 Sep 07 19:24:43.759022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 478/963] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:43 2022] GET /compute/v2.1/servers/d8ee899e-995d-4fd9-bf83-af9a5ee92c6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:44.980393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:44.980938 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:44.987573 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:44.988058 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:44.988503 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:44.989205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:44.989662 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:44.990091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:45.004098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 HTTP/1.1 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:24:45.005638 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.007271 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'e00e0417-c632-48c2-86de-591aef7988a1'} Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:45.008191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.009667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.011191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:45.011191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7811a31d-037a-4c00-a75a-4a14745ac9b1 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 404 len: 111 microversion: 2.1 time: 0.030500 Sep 07 19:24:45.011191 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 486/964] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:24:44 2022] DELETE /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:24:45.015522 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:24:45.016136 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] [instance: e00e0417-c632-48c2-86de-591aef7988a1] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:24:45.022742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:45.023228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:45.023665 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:45.024361 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:24:45.024816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:24:45.025243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:24:45.039160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] HTTP exception thrown: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Request method failure captured: Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 HTTP/1.1 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO7xfGtmm474bDpgwYPhXRa7Y468v_nodnG3O3s-JdF1x8osmt6mf3yss54phQvUhd17TI3VKGZJprxiBDjVhtJ_O6SpgEsrD54h6duvRz5lC1B_FDNmAP6D8jqUuAICees41-7slcpup8wxB0llgKSVFKzd5KVhNKPMOhYnLIHkYOM Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:24:45.040683 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_53d22963975b4bb891b1858f4afe3275"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/53d22963975b4bb891b1858f4afe3275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 53d22963975b4bb891b1858f4afe3275 Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeTestJSON-381247325 Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 7c8142614fe149fd9593cfba97ecad18 Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeTestJSON-381247325-project Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.042275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'e00e0417-c632-48c2-86de-591aef7988a1'} Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:24:45.043373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. Sep 07 19:24:45.044970 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:24:45.046404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] Returning 404 to user: Instance e00e0417-c632-48c2-86de-591aef7988a1 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:24:45.046404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c166c9f2-a945-4841-9093-92c8b38d42d2 tempest-AttachVolumeTestJSON-381247325 tempest-AttachVolumeTestJSON-381247325-project] 10.222.0.46 "GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1" status: 404 len: 111 microversion: 2.1 time: 0.030390 Sep 07 19:24:45.046404 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 479/965] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:24:45 2022] GET /compute/v2.1/servers/e00e0417-c632-48c2-86de-591aef7988a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:25:09.039400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:09.039973 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:09.042143 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:09.042810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:09.048027 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:09.048541 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:09.048984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:09.049725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:09.050184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:09.050664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:09.073769 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-526b1841-c2c2-49f8-8a60-9f7935366b1e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/ips" status: 200 len: 150 microversion: 2.1 time: 0.038376 Sep 07 19:25:09.074333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 487/966] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:25:09 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:10.203747 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:10.206413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:10.206596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4607a2cb-414f-4b4c-97d2-e16b4b51f22c", "tag": "59d0c88d-b4cc-4c21-8996-74e964b424d2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:10.218335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:10.219595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.220289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.221044 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.221781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:10.228469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.229818 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.230478 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.231224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.231856 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.232590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.246282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] Creating event network-changed:59d0c88d-b4cc-4c21-8996-74e964b424d2 for instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c on hv-cinder-84773 Sep 07 19:25:10.252150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-f79a80af-c903-4474-9fc4-bcae1b6d6bc8 req-91036979-c106-49bb-9f0c-cf58482d33a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049834 Sep 07 19:25:10.253057 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 488/967] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:25:10.264934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:25:10.567011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-324d80cb-f6be-4511-ad8f-4fc5d20d3f01 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 204 len: 0 microversion: 2.1 time: 0.370020 Sep 07 19:25:10.568232 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 480/968] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:25:10 2022] DELETE /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:25:10.576849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:10.577566 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:10.586763 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.587221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.587659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.588928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.589578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.590175 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.743206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5989d9-8247-443f-acd0-80ecbce968ac"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:10.746326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:10.756050 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.757994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.757994 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.758817 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:10.759883 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:10.760537 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:10.954803 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:10.964335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4e965f24-5bf3-4908-a342-8e3973d4ee5a tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1578 microversion: 2.1 time: 0.391645 Sep 07 19:25:10.965175 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 489/969] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:10 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1578 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:11.990450 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:11.991150 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:11.997352 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:11.997870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:11.998315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:11.999037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:11.999494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:11.999921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:12.133197 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:12.141317 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-356fdd49-7484-4ff4-a973-15bcee0cc527 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1578 microversion: 2.1 time: 0.155467 Sep 07 19:25:12.141903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 490/970] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:11 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:12.479951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-53414c0c-b1f0-4a22-bc12-26953f427f91 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.741596 Sep 07 19:25:12.480887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 481/971] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:25:10 2022] POST /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments => generated 194 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:25:12.925258 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4607a2cb-414f-4b4c-97d2-e16b4b51f22c", "name": "network-vif-deleted", "tag": "59d0c88d-b4cc-4c21-8996-74e964b424d2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:12.934471 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:12.935032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:12.935430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:12.948117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] Creating event network-vif-deleted:59d0c88d-b4cc-4c21-8996-74e964b424d2 for instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c on hv-cinder-84773 Sep 07 19:25:12.952821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-c367a6d5-a5d6-4da0-935c-2d85c0b2b0c1 req-99d2c6de-91f0-4c7f-a03e-ca976c95b80e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093031 Sep 07 19:25:12.953441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 491/972] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:13.166090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:13.167310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:13.174620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:13.180928 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:13.181530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:13.182280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:13.182781 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:13.183927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:13.254530 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:13.263884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-496dbce7-ac7e-4258-a5f5-e60ddc052dfd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1225 microversion: 2.1 time: 0.102728 Sep 07 19:25:13.264467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 482/973] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:13 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:14.288090 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:14.288799 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:14.295249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:14.295724 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:14.296158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:14.296866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:14.297325 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:14.297750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:14.329567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:14.330057 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:14.330496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:14.330969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lazy-loading 'fault' on Instance uuid 4607a2cb-414f-4b4c-97d2-e16b4b51f22c {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:25:14.377107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:14.385438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1a6bf53f-4bf5-40b7-8bb1-0b848d815595 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 200 len: 1230 microversion: 2.1 time: 0.102359 Sep 07 19:25:14.386011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 492/974] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:14 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:15.410281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:15.410866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 4607a2cb-414f-4b4c-97d2-e16b4b51f22c] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:15.417746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:15.418241 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:15.424160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:15.424160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:15.424160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:15.424160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:15.433263 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] HTTP exception thrown: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Request method failure captured: Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c HTTP/1.1 Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO5NUrM6-xhCjd-_Gu2W9GpxenQZV_TsZ5_qV9uK-c77N5ow6QXD-S1jnmFl6YEzI1T4QWEDmJPmXcvpJJjJloWSdNDIutoEXhLy1M6Mp7xS9ppHcpJNYaqjRCgH5B8EGa2cmqe_S3WynbkLvGS7HBuUrrvSE890dPMeOy-MTBwJFOE Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:25:15.434963 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7847d148d828478b8124c8d08c8c582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f9db5f73350c460f99e4ab5cdbe6907a Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. Sep 07 19:25:15.436725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '4607a2cb-414f-4b4c-97d2-e16b4b51f22c'} Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:15.437746 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. Sep 07 19:25:15.439391 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:15.441018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Returning 404 to user: Instance 4607a2cb-414f-4b4c-97d2-e16b4b51f22c could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:15.441018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fbcfe143-4952-441b-b82a-2f7c24a8d6dd tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c" status: 404 len: 111 microversion: 2.1 time: 0.030075 Sep 07 19:25:15.441018 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 483/975] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:15 2022] GET /compute/v2.1/servers/4607a2cb-414f-4b4c-97d2-e16b4b51f22c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:25:18.758033 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:18.759146 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:18.760333 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d24d7c4-b04d-41c4-aa53-1c82c092238b", "tag": "3b5df254-fa92-4d47-9a66-372798980963"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:18.767568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:18.768316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:18.768966 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:18.770088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:18.770228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:18.770579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:18.771021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:18.771961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:18.772601 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:18.783352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] Creating event network-changed:3b5df254-fa92-4d47-9a66-372798980963 for instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b on hv-cinder-84773 Sep 07 19:25:18.788575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-16e156e0-8b78-4f02-ba2f-243cc22ac948 req-6e0fb63e-c7ff-479d-afb9-d68f4abbc4e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031888 Sep 07 19:25:18.789246 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 484/976] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:25:18.801870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:25:19.120760 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-58825f97-49d2-4f84-bc61-07087bb1fd1c tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 204 len: 0 microversion: 2.1 time: 0.367316 Sep 07 19:25:19.121747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 493/977] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:25:18 2022] DELETE /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:25:19.132071 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:19.133139 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:19.139710 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:19.140298 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:19.140837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:19.141611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:19.142199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:19.142890 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:19.341158 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:19.357791 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-304ab377-bbdf-4337-9c74-d91eddeb9d42 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1577 microversion: 2.1 time: 0.230894 Sep 07 19:25:19.359356 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 485/978] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:19 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:20.382759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:20.383611 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:20.389832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:20.390310 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:20.390772 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:20.391460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:20.391928 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:20.392344 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:20.529365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:20.538820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f6ecc4c1-b5ee-4bae-9a9e-5179cd247484 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1577 microversion: 2.1 time: 0.160684 Sep 07 19:25:20.539488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 494/979] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:20 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:21.159914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5989d9-8247-443f-acd0-80ecbce968ac"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:21.162823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:21.169307 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.169797 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.170235 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.170978 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.171424 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.171848 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.262630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: POST /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments HTTP/1.1 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 74 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:25:21.264881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {"volumeAttachment": {"volumeId": "0c5989d9-8247-443f-acd0-80ecbce968ac"}} Sep 07 19:25:21.266526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'server_id': '0c73dc7b-fd01-42d6-863e-a56ca7d8a633', 'body': {'volumeAttachment': {'volumeId': '0c5989d9-8247-443f-acd0-80ecbce968ac'}}} Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:21.267907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:21.269689 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:21.271754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:21.271754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:21.271754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:21.271754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 Sep 07 19:25:21.271754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:21.273005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 400 to user: Invalid volume: volume 0c5989d9-8247-443f-acd0-80ecbce968ac is already attached to instances: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:21.274177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-27788358-af95-40c4-a3fa-c47b7dd0ef9e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118301 Sep 07 19:25:21.275255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 486/980] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:25:21 2022] POST /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 19:25:21.354856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:21.355344 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:21.361455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.361946 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.362453 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.363204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.363787 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.364211 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.564114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:21.565305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:21.576129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.576814 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.577251 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.577958 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.578606 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.579235 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.652238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'services' on Instance uuid 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:25:21.664127 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:21.675005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0813e301-d28e-4382-9361-67c937440d6f tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1390 microversion: 2.1 time: 0.116869 Sep 07 19:25:21.680108 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 487/981] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:21 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1390 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:21.680603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d24d7c4-b04d-41c4-aa53-1c82c092238b", "name": "network-vif-deleted", "tag": "3b5df254-fa92-4d47-9a66-372798980963"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:21.693997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.697823 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.698336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.712630 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] Creating event network-vif-deleted:3b5df254-fa92-4d47-9a66-372798980963 for instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b on hv-cinder-84773 Sep 07 19:25:21.718245 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-9a0853c6-8050-4879-8a26-58d82adc2490 req-84ccef89-e47a-4cae-8fe4-ead2987a7780 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041480 Sep 07 19:25:21.718882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 488/982] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:21.845327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8efc06fa-68e3-488c-936f-0a452396e1ff tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments/0c5989d9-8247-443f-acd0-80ecbce968ac" status: 202 len: 0 microversion: 2.1 time: 0.494231 Sep 07 19:25:21.846000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 495/983] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:25:21 2022] DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments/0c5989d9-8247-443f-acd0-80ecbce968ac => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:25:21.854997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:21.857301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:21.863662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.864203 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.864684 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.865398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:21.865862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:21.866292 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:21.900025 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7db10de5-8648-414e-8547-d21ee2441e4b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049325 Sep 07 19:25:21.907335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 489/984] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:25:21 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:22.703686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:22.704376 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:22.710955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:22.711393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:22.711849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:22.712598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:22.713094 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:22.713518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:22.744880 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:22.745351 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:22.745780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:22.746285 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lazy-loading 'fault' on Instance uuid 9d24d7c4-b04d-41c4-aa53-1c82c092238b {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:25:22.789412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9db5f73350c460f99e4ab5cdbe6907a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7847d148d828478b8124c8d08c8c582f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:22.799639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3c9cb981-753e-4f2f-bf79-80c89543fd00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 200 len: 1229 microversion: 2.1 time: 0.100980 Sep 07 19:25:22.800275 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 496/985] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:22 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:22.918209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:22.920426 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:22.927997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:22.928479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:22.928915 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:22.929794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:22.930255 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:22.930732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:22.964257 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fb943f8b-2ad5-4c04-ac15-441636121f46 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050032 Sep 07 19:25:22.965023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 490/986] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:25:22 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:23.825707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:23.826458 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: 9d24d7c4-b04d-41c4-aa53-1c82c092238b] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:23.833569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:23.834060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:23.834530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:23.835252 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:23.835699 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:23.836114 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:23.852456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] HTTP exception thrown: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Request method failure captured: Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b HTTP/1.1 Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO5NUrM6-xhCjd-_Gu2W9GpxenQZV_TsZ5_qV9uK-c77N5ow6QXD-S1jnmFl6YEzI1T4QWEDmJPmXcvpJJjJloWSdNDIutoEXhLy1M6Mp7xS9ppHcpJNYaqjRCgH5B8EGa2cmqe_S3WynbkLvGS7HBuUrrvSE890dPMeOy-MTBwJFOE Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:25:23.854218 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7847d148d828478b8124c8d08c8c582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: f9db5f73350c460f99e4ab5cdbe6907a Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. Sep 07 19:25:23.855860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '9d24d7c4-b04d-41c4-aa53-1c82c092238b'} Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:23.856679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. Sep 07 19:25:23.857996 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:23.860332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Returning 404 to user: Instance 9d24d7c4-b04d-41c4-aa53-1c82c092238b could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:23.860332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b0be342d-70b6-4435-9a1d-c9bd0d6e3bf2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b" status: 404 len: 111 microversion: 2.1 time: 0.035689 Sep 07 19:25:23.860332 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 497/987] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:23 2022] GET /compute/v2.1/servers/9d24d7c4-b04d-41c4-aa53-1c82c092238b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:25:23.977721 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:23.980130 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:23.986779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:23.987339 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:23.988029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:23.988805 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:23.989343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:23.990423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.020696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fdcb0de8-7869-48a2-b40b-ebbc7f31a5bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047370 Sep 07 19:25:24.021358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 491/988] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:25:23 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:25:24.085941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:24.086502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:24.093099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.093849 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.094370 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.095276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.095998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.096492 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.124129 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:25:24.409402 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:24.409997 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:24.416548 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.417028 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.417400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-12ccf0d5-fafa-4d46-a564-28b115f95962 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 204 len: 0 microversion: 2.1 time: 0.335548 Sep 07 19:25:24.417514 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.417991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 498/989] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:25:24 2022] DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:25:24.418120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.418596 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.419029 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.433021 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] HTTP exception thrown: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.433259 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:24.434000 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Request method failure captured: Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 HTTP/1.1 Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO5NUrM6-xhCjd-_Gu2W9GpxenQZV_TsZ5_qV9uK-c77N5ow6QXD-S1jnmFl6YEzI1T4QWEDmJPmXcvpJJjJloWSdNDIutoEXhLy1M6Mp7xS9ppHcpJNYaqjRCgH5B8EGa2cmqe_S3WynbkLvGS7HBuUrrvSE890dPMeOy-MTBwJFOE Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:25:24.434754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7847d148d828478b8124c8d08c8c582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f9db5f73350c460f99e4ab5cdbe6907a Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.436239 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'e9beb5e5-4d22-41df-8c6b-48336dccb119'} Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:24.437052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.438311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.439662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Returning 404 to user: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:24.439662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8dbb684e-ee2c-403e-a50e-eaf708076336 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 404 len: 111 microversion: 2.1 time: 0.030849 Sep 07 19:25:24.439662 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 492/990] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:25:24 2022] DELETE /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:25:24.443776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.444278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.444725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.445570 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.446664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.446664 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.449866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:24.450742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] [instance: e9beb5e5-4d22-41df-8c6b-48336dccb119] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:24.457377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.457946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.458967 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.459740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:24.460287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:24.460777 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:24.476672 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] HTTP exception thrown: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Request method failure captured: Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 HTTP/1.1 Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO5NUrM6-xhCjd-_Gu2W9GpxenQZV_TsZ5_qV9uK-c77N5ow6QXD-S1jnmFl6YEzI1T4QWEDmJPmXcvpJJjJloWSdNDIutoEXhLy1M6Mp7xS9ppHcpJNYaqjRCgH5B8EGa2cmqe_S3WynbkLvGS7HBuUrrvSE890dPMeOy-MTBwJFOE Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:25:24.487473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7847d148d828478b8124c8d08c8c582f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7847d148d828478b8124c8d08c8c582f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 7847d148d828478b8124c8d08c8c582f Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-TestVolumeBootPattern-1553712397 Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: f9db5f73350c460f99e4ab5cdbe6907a Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-TestVolumeBootPattern-1553712397-project Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.489764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'e9beb5e5-4d22-41df-8c6b-48336dccb119'} Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:24.491000 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. Sep 07 19:25:24.492516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:25:24.493881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Returning 404 to user: Instance e9beb5e5-4d22-41df-8c6b-48336dccb119 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:24.493881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a600af93-cc38-4017-a783-92e1f1d6b2c2 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119" status: 404 len: 111 microversion: 2.1 time: 0.037860 Sep 07 19:25:24.493881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 493/991] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:24 2022] GET /compute/v2.1/servers/e9beb5e5-4d22-41df-8c6b-48336dccb119 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:25:24.600789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:24.609306 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-8ba2963b-f2e2-4fa8-8c50-cd111fe6210e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1681 microversion: 2.1 time: 0.180181 Sep 07 19:25:24.613359 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 499/992] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:24 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:25.633376 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:25.633993 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:25.641358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:25.641921 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:25.642532 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:25.643531 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:25.644451 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:25.645107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:25.842249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:25.856428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a432b961-d57a-4325-b3d7-6b4117a46bc3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1681 microversion: 2.1 time: 0.227110 Sep 07 19:25:25.857450 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 494/993] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:25 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:26.011253 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-632778f4-fe75-40bd-b573-ff3cc9fb2a00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] Calling method '.version_select at 0x7ff4da12bf70>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:26.104735 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-632778f4-fe75-40bd-b573-ff3cc9fb2a00 tempest-TestVolumeBootPattern-1553712397 tempest-TestVolumeBootPattern-1553712397-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-290973285" status: 202 len: 0 microversion: 2.1 time: 0.094869 Sep 07 19:25:26.107070 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 500/994] 10.222.0.46 () {58 vars in 1260 bytes} [Wed Sep 7 19:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-290973285 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:25:26.882756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:26.884778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:26.897521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:26.898393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:26.899969 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:26.901178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:26.901851 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:26.902773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:27.443380 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:27.457254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4fad6631-2fd8-4816-9fa4-c1198669a855 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1681 microversion: 2.1 time: 0.580902 Sep 07 19:25:27.459543 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 495/995] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:26 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1681 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:27.870245 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c73dc7b-fd01-42d6-863e-a56ca7d8a633", "name": "network-vif-deleted", "tag": "340dfd15-c13e-4ef5-9236-6c10a631b2f1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:27.893269 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:27.893757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:27.894187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:27.916868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] Creating event network-vif-deleted:340dfd15-c13e-4ef5-9236-6c10a631b2f1 for instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 on hv-cinder-84773 Sep 07 19:25:27.922226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-2651e733-1258-439e-8f55-ca796c32d046 req-10d26ac2-ffd6-430c-abf7-3a854bec8d2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056967 Sep 07 19:25:27.923185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 501/996] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:28.485314 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:28.486060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:28.499274 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:28.499778 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:28.500225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:28.503225 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:28.503736 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:28.504493 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:28.561979 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:28.563368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:28.563985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:28.564754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'fault' on Instance uuid 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:25:28.570523 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:28.620346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:28.629865 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-26b0502d-0049-46d9-bf37-699b01a8fa14 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 200 len: 1330 microversion: 2.1 time: 0.148851 Sep 07 19:25:28.631096 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 496/997] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:28 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 1330 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:29.662447 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:29.663194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:29.683368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:29.692230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:29.692230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:29.692230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:29.692230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:29.693262 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:29.710525 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 HTTP/1.1 Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:25:29.712495 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:25:29.717355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '0c73dc7b-fd01-42d6-863e-a56ca7d8a633'} Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:25:29.720126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:25:29.721697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:25:29.723118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:25:29.723118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1f4f0ed2-ff7b-45f7-b454-4f006029f752 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 404 len: 111 microversion: 2.1 time: 0.058491 Sep 07 19:25:29.725056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 502/998] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:29 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:25:29.735346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-92c719a2-0505-44df-aeb5-cbcba6003d9b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '.version_select at 0x7ff4ddb18550>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:29.822413 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-92c719a2-0505-44df-aeb5-cbcba6003d9b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-487169992" status: 202 len: 0 microversion: 2.1 time: 0.092999 Sep 07 19:25:29.823231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 497/999] 10.222.0.46 () {58 vars in 1218 bytes} [Wed Sep 7 19:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-487169992 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:25:31.436327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-489a3f98-4a95-4039-a871-eaf440aebc2e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: .version_select at 0x7ff4da14f670>, body: {"keypair": {"name": "tempest-keypair-1230907618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA5vLIhSwNITopg1dJys2CxhQ6Q+c+8hYIO5R3rMrvfJ/tQmyWCw2BRxnFcVIc+bCPYvURZO3HE/F0OJZ7wYX7wP6Z6rJK95wd3FJAhjLY3I6Ulx7Wh9vOiQnaKnhicsQ=="}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:31.452678 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-489a3f98-4a95-4039-a871-eaf440aebc2e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:25:31.456742 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-489a3f98-4a95-4039-a871-eaf440aebc2e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'key_pairs'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:25:31.550891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-489a3f98-4a95-4039-a871-eaf440aebc2e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118109 Sep 07 19:25:31.551642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 503/1000] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:25:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:25:34.915930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75547365", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53498e05-b723-4a63-83c7-f76293f9aace"}], "security_groups": [{"name": "tempest-securitygroup--762666641"}], "key_name": "tempest-keypair-1230907618", "user_data": "}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:35.187638 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] validate_networks() for [('53498e05-b723-4a63-83c7-f76293f9aace', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:25:36.488685 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:25:36.491811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:25:36.492471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:25:36.493660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:25:36.493934 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:25:36.505982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:36.506590 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:36.507815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:36.508043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:36.508585 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:36.509132 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:36.536022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:25:36.536022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Getting quotas for user c639d3e06c4c4fcc834979684b00af6c and project 56c66a304fdf4e9eba6ca0b7a15f492b. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:25:36.549046 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:25:36.555637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:25:36.693310 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e838ec9-ad52-4fea-880c-37f4bc54e445 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.782744 Sep 07 19:25:36.694875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 498/1001] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:25:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 19:25:36.705881 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b3c6d66c-70ac-41df-b863-6fc30a668bd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:36.707175 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b3c6d66c-70ac-41df-b863-6fc30a668bd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:36.796802 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b3c6d66c-70ac-41df-b863-6fc30a668bd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:36.809088 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b3c6d66c-70ac-41df-b863-6fc30a668bd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1240 microversion: 2.1 time: 0.105666 Sep 07 19:25:36.819343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 504/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:36 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:37.849435 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:37.850068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:37.857954 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:37.858439 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:37.858913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:37.859629 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:37.860084 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:37.866240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:37.979908 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:37.987719 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a284f6c4-846a-4d09-8122-4f66f5fac0f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1244 microversion: 2.1 time: 0.143610 Sep 07 19:25:37.988287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 499/1003] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:37 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1244 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:39.010820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:39.010820 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:39.022293 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:39.022814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:39.023789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:39.024012 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:39.024396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:39.024825 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:39.050753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:39.103294 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:39.111614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d582c167-5137-4dcd-83fc-4cd667a2fbd0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1292 microversion: 2.1 time: 0.105585 Sep 07 19:25:39.112477 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 505/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:39 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:39.480554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-97e153dc-026e-424c-9b3c-fe28d0c11a21 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Action: 'create', calling method: .version_select at 0x7ff4dda78dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1346289401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM7efbtJTFwWQ3ncxURfI83e9dVa43m9SfV+kdXh9sHgd++tQigPeY3NSFes829wIFoOtCDfbb6FIyg833/PwoupOQN6yAnGto1ZS80n+Yq02w/iXVLKgUVmAmLwpBViw=="}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:39.498504 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-97e153dc-026e-424c-9b3c-fe28d0c11a21 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Getting quotas for project 67ebd705b0d94555bbc24018ac4b9d0f. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:25:39.503563 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-97e153dc-026e-424c-9b3c-fe28d0c11a21 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Getting quotas for user 5076bee4033c4fa8837c3273a2e53a7a and project 67ebd705b0d94555bbc24018ac4b9d0f. Resources: {'key_pairs'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:25:39.584648 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-97e153dc-026e-424c-9b3c-fe28d0c11a21 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321740 Sep 07 19:25:39.586126 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 500/1005] 10.222.0.46 () {60 vars in 1159 bytes} [Wed Sep 7 19:25:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:40.136931 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:40.137632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:40.144832 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:40.145819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:40.146254 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:40.147041 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:40.147479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:40.147957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:40.368304 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:40.378126 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-9e764e59-1a2f-4df5-99cd-ab8c0f45c045 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.245496 Sep 07 19:25:40.378965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 506/1006] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:40 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:41.402966 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:41.403871 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:41.407491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:41.423540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:41.424288 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:41.424773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:41.425529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:41.426012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:41.426448 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:41.581497 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:41.587761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e", "tag": "d4a89ed6-3169-4485-88f3-fd84a6a8320d"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:41.591632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-292f6230-0111-4c95-b797-b943eaee1b0b tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.193837 Sep 07 19:25:41.592520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 501/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:41 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:41.603365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:41.610971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:41.617785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:41.617785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:41.625468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] Creating event network-changed:d4a89ed6-3169-4485-88f3-fd84a6a8320d for instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e on hv-cinder-84773 Sep 07 19:25:41.630987 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-10514a90-3737-4a20-9d69-14194be85300 req-faecb288-7814-450c-920f-f61afdf7f825 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046798 Sep 07 19:25:41.632160 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 507/1008] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:25:42.615764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:42.616341 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:42.623726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:42.624213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:42.624651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:42.625558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:42.626019 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:42.626446 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:42.763014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:42.770841 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-09675c66-3235-4bd5-9d4c-c09131ce1efe tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.159714 Sep 07 19:25:42.771421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 502/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:42 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:25:43.797347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:43.798776 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:43.805767 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:43.806333 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:43.806805 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:43.807520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:43.807974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:43.808400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:44.119479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:44.127371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-547dacf2-76a2-493d-a0d2-57ec295b5f09 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.336536 Sep 07 19:25:44.127955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 508/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:43 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:45.152540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:45.153405 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:45.162544 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:45.163333 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:45.163733 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:45.164554 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:45.165714 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:45.166301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:45.309938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:45.317775 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0df18919-472d-444f-8ea5-36e9afb54785 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.171862 Sep 07 19:25:45.318281 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 503/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:45 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:46.341267 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:46.347056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:46.349037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:46.349519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:46.349955 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:46.350674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:46.351132 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:46.351619 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:46.485214 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:46.493222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-556ace75-71b5-4f9e-a412-0c83b113f3a8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.155756 Sep 07 19:25:46.496438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 509/1012] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:46 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:47.516880 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:47.517428 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:47.519771 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:47.525149 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:47.525632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:47.526070 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:47.526790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:47.527607 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:47.528039 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:47.659052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:47.667604 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d4a8e76c-90f2-4d5c-a536-c4d8c49be7db tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.154614 Sep 07 19:25:47.668231 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 504/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:47 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:48.387917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:48.448767 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e", "name": "network-vif-plugged", "status": "completed", "tag": "d4a89ed6-3169-4485-88f3-fd84a6a8320d"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:48.458856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:48.459345 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:48.459779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:48.472387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] Creating event network-vif-plugged:d4a89ed6-3169-4485-88f3-fd84a6a8320d for instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e on hv-cinder-84773 Sep 07 19:25:48.478542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-ef5bd50c-3a32-4aa1-91db-37f946e1d30a req-3dc00a64-bce3-4200-903c-9f7a43f98ce1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095290 Sep 07 19:25:48.479195 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 510/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:48.690144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:48.690721 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:48.697116 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:48.697597 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:48.702802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:48.702802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:48.702802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:48.702802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:48.840290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:48.848804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1e51f464-9af9-45cd-a519-d60095372549 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.162062 Sep 07 19:25:48.849709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 505/1015] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:48 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:49.873503 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:49.874215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:49.881531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:49.882026 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:49.882462 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:49.883194 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:49.883650 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:49.884096 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:50.013155 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:50.020890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-59225d72-96c8-4d89-8f21-aa66e513964d tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1365 microversion: 2.1 time: 0.152398 Sep 07 19:25:50.021451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 511/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:49 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:51.043557 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:51.044169 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:51.046011 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=10 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:25:51.050825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:51.051308 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:51.055519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:51.055519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:51.055519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:51.055519 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:51.187678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:51.195831 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-993300ba-886b-4c10-84b0-b1a385032d11 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1555 microversion: 2.1 time: 0.156382 Sep 07 19:25:51.196388 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 506/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:51 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:25:51.218432 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:51.218960 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:51.225139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:51.225623 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:51.226055 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:51.226807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:51.227263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:51.227686 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:51.306586 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-617e4663-0539-4e93-8bc0-022af66049f9 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092078 Sep 07 19:25:51.307178 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 512/1018] 10.222.0.46 () {58 vars in 1275 bytes} [Wed Sep 7 19:25:51 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:52.363517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e", "tag": "d4a89ed6-3169-4485-88f3-fd84a6a8320d"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:52.373678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:52.374163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:52.374750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:52.386578 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] Creating event network-changed:d4a89ed6-3169-4485-88f3-fd84a6a8320d for instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e on hv-cinder-84773 Sep 07 19:25:52.392328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-307774f4-90c5-48b7-8dbd-199ae7e9065e req-1ea7f182-264c-4054-aaaf-8a872d419b50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089127 Sep 07 19:25:52.392923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 507/1019] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:25:57.840602 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-458666437", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1346289401", "security_groups": [{"name": "tempest-secgroup-smoke-1131747387"}], "networks": [{"uuid": "cefa8a64-561d-4222-866d-811a083e2473"}], "block_device_mapping_v2": [{"uuid": "fb91d7f2-f77d-4786-b669-57ae63add2bb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:25:57.953277 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.network.neutron [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] validate_networks() for [('cefa8a64-561d-4222-866d-811a083e2473', None, None, None, None, None)] {{(pid=121080) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:25:58.635081 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Flavor limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:25:58.635509 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Image limits 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:25:58.636034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Flavor pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:25:58.636445 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Image pref 0:0:0 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:25:58.636858 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.virt.hardware [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:25:58.645607 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:58.646796 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:58.647238 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:58.648020 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:25:58.648427 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:25:58.648854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:25:58.665576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Getting quotas for project 67ebd705b0d94555bbc24018ac4b9d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:25:58.669496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.quota [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Getting quotas for user 5076bee4033c4fa8837c3273a2e53a7a and project 67ebd705b0d94555bbc24018ac4b9d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=121080) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:25:58.725260 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Going to run 1 instances... {{(pid=121080) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:25:58.727443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb91d7f2-f77d-4786-b669-57ae63add2bb',volume_size=None,volume_type=None)] {{(pid=121080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:25:59.041438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ffc4e287-5023-41b1-8683-63f5a3d61725 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205099 Sep 07 19:25:59.045441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 513/1020] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:25:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:25:59.054894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-1c2e8ed5-89fd-4d5a-b8be-f32f86dd2939 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:25:59.055597 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-1c2e8ed5-89fd-4d5a-b8be-f32f86dd2939 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:25:59.108750 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-1c2e8ed5-89fd-4d5a-b8be-f32f86dd2939 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:25:59.116332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-1c2e8ed5-89fd-4d5a-b8be-f32f86dd2939 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1088 microversion: 2.1 time: 0.066690 Sep 07 19:25:59.116919 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 508/1021] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:25:59 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:00.139660 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:00.140311 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:00.147916 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:00.148400 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:00.148835 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:00.149528 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:00.149981 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:00.150404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:00.220655 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:00.228473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-75a840a2-20a5-4381-84b0-a47670c4b3b3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1138 microversion: 2.1 time: 0.093237 Sep 07 19:26:00.229040 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 514/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:00 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:01.251801 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:01.252453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:01.259794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:01.260274 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:01.260698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:01.261693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:01.262138 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:01.262573 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:01.329704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:01.338320 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-4b0918dc-26b6-4d1c-9317-f67c62f41450 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1204 microversion: 2.1 time: 0.090549 Sep 07 19:26:01.338926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 509/1023] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:01 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1204 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:26:02.361347 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:02.361970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:02.369206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:02.369692 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:02.370133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:02.370859 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:02.371320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:02.371751 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:02.505072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:02.515152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3a998f52-3331-4c40-9587-01c42b3bffb5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1272 microversion: 2.1 time: 0.157509 Sep 07 19:26:02.515921 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 515/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:02 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:02.832811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:26:02.843562 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:02.844042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:02.844471 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:02.856043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] Creating event network-changed:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:26:02.860887 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-b31360b2-b811-4a52-98f9-eb8b0df2feb3 req-ec74afd1-9bb2-49c8-8d9b-ab3e652cfcbb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031867 Sep 07 19:26:02.861473 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 510/1025] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:03.539031 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:03.539674 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:03.545967 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:03.546438 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:03.546993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:03.547612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:03.548069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:03.548494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:03.675838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:03.684184 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b9a50408-7d45-40b3-bb39-d33bafbf582e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.149143 Sep 07 19:26:03.684759 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 516/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:03 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:04.709501 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:04.710200 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:04.716482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:04.716973 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:04.717445 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:04.718140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:04.718619 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:04.719052 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:04.851324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:04.858355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-71a5976e-84b9-4a92-b920-3e53b9e3d405 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.154346 Sep 07 19:26:04.858971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 511/1027] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:04 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:05.882435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:05.883092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:05.889430 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:05.889917 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:05.890353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:05.891075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:05.891534 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:05.891962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:06.021308 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:06.029764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6802c321-9fff-4b9b-8935-45976893229e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.151729 Sep 07 19:26:06.030321 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 517/1028] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:05 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:07.052218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:07.053335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:07.059742 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:07.060226 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:07.060666 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:07.061355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:07.061808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:07.062234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:07.066208 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=63 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:07.192611 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:07.200929 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8438b521-963a-4047-97c8-ef8a1720dbbc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.152610 Sep 07 19:26:07.201495 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 512/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:07 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:08.223684 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:08.224230 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:08.230876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:08.231442 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:08.231891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:08.232752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:08.233204 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:08.233697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:08.363673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:08.371338 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6d34467e-1c2c-4ae6-8dc6-f3ec7e1ee606 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.151740 Sep 07 19:26:08.371910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 518/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:08 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:09.394487 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:09.395132 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:09.397951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:09.402941 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:09.403417 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:09.403847 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:09.404528 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:09.404977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:09.405392 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:09.533904 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:09.542157 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b05192d6-7657-4614-9edc-e64b68c3ab5f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.151562 Sep 07 19:26:09.542754 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 513/1031] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:09 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:10.564531 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:10.565110 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:10.567039 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:10.567705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=6 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:10.572929 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:10.575206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:10.575206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:10.575206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:10.575206 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:10.575603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:10.708231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:10.716398 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a0438487-f64d-4878-a31f-3f4c308d6998 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.155882 Sep 07 19:26:10.716964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 519/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:10 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:11.739965 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:11.741147 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:11.747706 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:11.748195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:11.748636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:11.749331 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:11.749790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:11.750218 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:11.881379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:11.889006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8546d503-933e-4761-96ea-3ea643f7ad39 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.153123 Sep 07 19:26:11.889577 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 514/1033] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:11 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:12.912042 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:12.912798 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:12.919329 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:12.919817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:12.920248 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:12.920944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:12.921391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:12.922037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:12.925785 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=73 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:13.058417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:13.066577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-75fcd8e0-f089-4f47-85c3-ad0e3d784fa4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.158294 Sep 07 19:26:13.070185 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 520/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:12 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:14.089946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:14.090583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:14.092980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=30 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:14.097643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:14.098129 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:14.098583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:14.099280 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:14.099944 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:14.100372 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:14.230913 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:14.239001 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f19546bd-ed14-426e-a1b8-d3ef32716176 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.152987 Sep 07 19:26:14.239628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 515/1035] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:14 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:14.503980 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "name": "network-vif-plugged", "status": "completed", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:26:14.509856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:14.514959 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:14.515456 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:14.515876 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:14.528808 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] Creating event network-vif-plugged:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:26:14.533726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-18f0bd81-92a9-4d42-9d07-fb9d0b58f81c req-70067728-8618-4320-be8c-4dc3998845fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033526 Sep 07 19:26:14.534304 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 521/1036] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:15.261661 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:15.262325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:15.268655 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:15.269126 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:15.269550 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:15.270224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:15.270704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:15.271618 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:15.404355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:15.411674 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-02358ce7-1f03-4fae-97bd-98f33bbce426 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1260 microversion: 2.1 time: 0.153924 Sep 07 19:26:15.412770 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 516/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:15 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:16.436919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:16.437636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:16.444249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:16.444789 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:16.445221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:16.445903 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:16.446418 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:16.446877 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:16.577937 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:16.586183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-cdc0e726-ad0f-4212-a879-ff91a723c039 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1445 microversion: 2.1 time: 0.154013 Sep 07 19:26:16.586781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 522/1038] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:16 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:26:16.613014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:16.613671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:16.620862 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:16.621453 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:16.621888 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:16.622588 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:16.623042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:16.623460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:16.753678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:16.761520 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d6cbf563-e1b7-4861-aa3b-91a83fa5c5d9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1445 microversion: 2.1 time: 0.152526 Sep 07 19:26:16.762081 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 517/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:16 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:18.629059 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:26:18.639227 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:18.639701 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:18.640127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:18.651677 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] Creating event network-changed:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:26:18.657112 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-55876159-c54a-4db2-919f-131a7679d33e req-521cb745-4d0c-43b1-93b6-33edf807289e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031488 Sep 07 19:26:18.657530 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 523/1040] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:28.238381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:28.238827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:28.241659 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=5 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:28.242324 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=35 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:28.246968 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:28.247716 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:28.248051 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:28.248757 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:28.249213 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:28.249643 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:28.273779 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-53a85dd4-75ec-4135-a474-fceb70e9f2bd tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/ips" status: 200 len: 150 microversion: 2.1 time: 0.040133 Sep 07 19:26:28.280393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 518/1041] 10.222.0.46 () {58 vars in 1248 bytes} [Wed Sep 7 19:26:28 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:29.925606 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da7f030d-1688-4eaf-953c-ce7f3d2cc230"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:26:29.930490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:29.933817 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=5 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:29.934585 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=15 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:26:29.939479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:29.943282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:29.943282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:29.943282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:29.943282 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:29.943718 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:30.636939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-24b373bc-8e3a-43ad-ab92-d18ad19b4be4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "POST /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715442 Sep 07 19:26:30.637560 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 524/1042] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:26:29 2022] POST /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments => generated 194 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:38.270160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:38.270749 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:38.278538 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:38.283917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:38.283917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:38.283917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:38.283917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:38.284322 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:38.360687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'services' on Instance uuid c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:26:38.513460 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13ebc896-5f37-4d57-b404-24207e8a6975 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments/da7f030d-1688-4eaf-953c-ce7f3d2cc230" status: 202 len: 0 microversion: 2.1 time: 0.247554 Sep 07 19:26:38.514068 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 519/1043] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:26:38 2022] DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments/da7f030d-1688-4eaf-953c-ce7f3d2cc230 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 19:26:38.524224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:38.527522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:38.534482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:38.535354 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:38.535488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:38.536118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:38.536570 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:38.536989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:38.572740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-eaf905e0-6f65-41e0-a221-fcdb0bee6295 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053839 Sep 07 19:26:38.573578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 525/1044] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:26:38 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:26:39.586615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:39.589455 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:39.595569 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:39.596049 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:39.596603 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:39.597249 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:39.597701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:39.598128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:39.629539 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f7ef5267-2899-4dc1-a781-bc5430ed21ef tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047826 Sep 07 19:26:39.630097 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 520/1045] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:26:39 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:40.641964 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:40.644154 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:40.650733 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:40.651221 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:40.651910 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:40.652612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:40.653068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:40.653496 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:40.682030 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-1b681d9e-6308-42e5-b7d7-c37066e1df77 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044078 Sep 07 19:26:40.682514 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 526/1046] 10.222.0.46 () {58 vars in 1302 bytes} [Wed Sep 7 19:26:40 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 19:26:40.744412 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:40.744917 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:40.751282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:40.751763 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:40.752197 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:40.752884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:40.753338 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:40.753764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:40.780980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:26:41.027177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-5477aa89-dd9e-408e-9fc5-c2f60f9e0317 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 204 len: 0 microversion: 2.1 time: 0.286444 Sep 07 19:26:41.027681 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 521/1047] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:26:40 2022] DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:26:41.035836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:41.036460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:41.048405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:41.048405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:41.048405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:41.048405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:41.048778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:41.048778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:41.178731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:41.186941 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7d07dfde-8090-447b-a548-f6e30d61eb82 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1680 microversion: 2.1 time: 0.154954 Sep 07 19:26:41.187501 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 527/1048] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:41 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:42.210685 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:42.211423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:42.217761 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:42.218248 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:42.218743 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:42.219448 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:42.219903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:42.220328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:42.350811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:42.358491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-6e3f7762-3c1e-4d2d-a48f-dcf924064178 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1680 microversion: 2.1 time: 0.152180 Sep 07 19:26:42.359078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 522/1049] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:42 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:43.381919 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:43.382588 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:43.389463 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:43.389947 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:43.390387 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:43.391113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:43.391570 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:43.391997 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:43.539393 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:43.540927 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b4375448-d3cf-47e2-a887-108f0651c4c0 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1680 microversion: 2.1 time: 0.162777 Sep 07 19:26:43.541855 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 528/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:43 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:43.951773 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e", "name": "network-vif-deleted", "tag": "d4a89ed6-3169-4485-88f3-fd84a6a8320d"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:26:43.962785 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:43.963297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:43.963731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:43.975033 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] Creating event network-vif-deleted:d4a89ed6-3169-4485-88f3-fd84a6a8320d for instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e on hv-cinder-84773 Sep 07 19:26:43.980922 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-39db8ec9-7842-4c95-be40-9087aaa01dc3 req-7ebd96a8-2485-4aa0-9249-e88546fc96ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 Sep 07 19:26:43.981540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 523/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:26:44.565779 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:44.566396 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:44.572969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:44.573451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:44.573923 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:44.574661 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:44.575099 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:44.575526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:44.607976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:44.607976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:44.608659 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:44.609005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lazy-loading 'fault' on Instance uuid c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:26:44.648365 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c639d3e06c4c4fcc834979684b00af6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c66a304fdf4e9eba6ca0b7a15f492b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:26:44.657272 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-805faf9d-5938-46e2-ab11-792a5f509ede tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 200 len: 1330 microversion: 2.1 time: 0.095669 Sep 07 19:26:44.657778 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 529/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:44 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:26:45.682440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:45.683177 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:45.689758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:45.690246 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:45.690722 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:45.691419 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:45.691875 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:45.692317 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:45.705930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e HTTP/1.1 Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:26:45.707582 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:45.709279 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e'} Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:45.710398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:45.712043 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:45.714183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:45.714183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-944a122d-1fc2-43f1-b21b-d63024fe9be3 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 404 len: 111 microversion: 2.1 time: 0.030838 Sep 07 19:26:45.714183 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 524/1053] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:45 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:45.718284 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-c25a4fd9-7837-443b-9a9d-ae95d5225925 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '.version_select at 0x7ff4da0ce310>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:45.799502 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-c25a4fd9-7837-443b-9a9d-ae95d5225925 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230907618" status: 202 len: 0 microversion: 2.1 time: 0.084914 Sep 07 19:26:45.800095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 530/1054] 10.222.0.46 () {58 vars in 1221 bytes} [Wed Sep 7 19:26:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230907618 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:26:47.837553 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:47.838731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:47.845140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:47.845624 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:47.846063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:47.846806 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:47.847267 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:47.847704 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:47.860983 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e HTTP/1.1 Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:26:47.862533 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.864199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': 'c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e'} Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:47.865162 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.866728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.868370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:47.868370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-db164706-9221-41f9-a7eb-f84dfcd06c08 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 404 len: 111 microversion: 2.1 time: 0.030278 Sep 07 19:26:47.868370 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 525/1055] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:26:47 2022] DELETE /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:47.872755 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:47.873378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:47.880019 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:47.880507 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:47.880940 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:47.881629 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:47.882085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:47.882515 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:47.895781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e HTTP/1.1 Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:26:47.897412 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.899079 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': 'c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e'} Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:47.900145 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. Sep 07 19:26:47.902644 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:47.904109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:47.904109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a67db115-7376-4a67-bd5b-7d0bd14a847f tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e" status: 404 len: 111 microversion: 2.1 time: 0.030373 Sep 07 19:26:47.904109 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 531/1056] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:47 2022] GET /compute/v2.1/servers/c4d6ad31-9d9f-4d05-86aa-7d88bdb3471e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:26:49.125469 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:49.125972 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:49.132484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.132968 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.133403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.134102 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.134583 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.135012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.148907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 HTTP/1.1 Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:26:49.150474 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.152168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '0c73dc7b-fd01-42d6-863e-a56ca7d8a633'} Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:49.153069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.154696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.156379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:49.156379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-60b5bbf3-c4ce-4371-a21c-deb39de81d6e tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 404 len: 111 microversion: 2.1 time: 0.030251 Sep 07 19:26:49.156379 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 526/1057] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:26:49 2022] DELETE /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:49.160435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:49.161056 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 0c73dc7b-fd01-42d6-863e-a56ca7d8a633] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:49.168128 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.168603 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.169037 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.169729 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.170183 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.170636 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.184373 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 HTTP/1.1 Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:26:49.185887 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.187519 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '0c73dc7b-fd01-42d6-863e-a56ca7d8a633'} Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:49.188595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. Sep 07 19:26:49.190098 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.191766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 0c73dc7b-fd01-42d6-863e-a56ca7d8a633 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:49.191766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d9424aa-d70a-452a-95e4-486efff4a18c tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633" status: 404 len: 111 microversion: 2.1 time: 0.030710 Sep 07 19:26:49.191766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 532/1058] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:49 2022] GET /compute/v2.1/servers/0c73dc7b-fd01-42d6-863e-a56ca7d8a633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:26:49.195463 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:49.195962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:49.201740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.202222 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.202692 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.203425 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.203884 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.204311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.217626 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc HTTP/1.1 Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:26:49.219219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.220903 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '8bcc47db-c9f4-43e3-9418-09d96e93e0dc'} Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:49.221990 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.223521 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.225234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:49.225234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b68f9da5-0101-4760-823b-14d9092a0a42 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 404 len: 111 microversion: 2.1 time: 0.028969 Sep 07 19:26:49.225234 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 527/1059] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:26:49 2022] DELETE /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:49.228986 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:49.229597 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 8bcc47db-c9f4-43e3-9418-09d96e93e0dc] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:49.236608 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.237127 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.237840 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.238215 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:49.238708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:49.239134 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:49.253251 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc HTTP/1.1 Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:26:49.254811 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.256481 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '8bcc47db-c9f4-43e3-9418-09d96e93e0dc'} Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:49.257360 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. Sep 07 19:26:49.258926 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:49.260369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 8bcc47db-c9f4-43e3-9418-09d96e93e0dc could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:49.260369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3d50a8a5-122a-47fc-972a-8177ba3be9a4 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc" status: 404 len: 111 microversion: 2.1 time: 0.031076 Sep 07 19:26:49.260369 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 533/1060] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:49 2022] GET /compute/v2.1/servers/8bcc47db-c9f4-43e3-9418-09d96e93e0dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:50.548637 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:50.549134 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:50.555729 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:50.556204 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:50.556636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:50.557328 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:50.557782 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:50.558207 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:50.571767 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 HTTP/1.1 Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:26:50.573316 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.574992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5'} Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:50.576558 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.578079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.579584 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:50.579584 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-253ed542-09b9-4f23-b5c1-faf9e4a388c8 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 404 len: 111 microversion: 2.1 time: 0.029934 Sep 07 19:26:50.579584 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 528/1061] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:26:50 2022] DELETE /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:26:50.583545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:26:50.584153 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] [instance: 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:26:50.590426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:50.590936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:50.591368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:50.592052 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:26:50.592503 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:26:50.592924 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:26:50.605988 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] HTTP exception thrown: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Request method failure captured: Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 HTTP/1.1 Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGO9TusCmN2V1DnWzgcNDc6YeTBjwvaaW1N509ayusD04wxC3Wx6U2O0V9uQ67pUF5vQ2YDahpuiOFUSqyeCv3h2lKoAnMqsN5W3OQybfOh4YzSbqXGsCEsiJedLEi2Wz6RV_MbWE0GYjjr41fUI4f9QVMac_y4sL1Iof9YtJ2u5QP4Q Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:26:50.608047 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/56c66a304fdf4e9eba6ca0b7a15f492b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 56c66a304fdf4e9eba6ca0b7a15f492b Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1677661396 Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: c639d3e06c4c4fcc834979684b00af6c Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-AttachVolumeNegativeTest-1677661396-project Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.609683 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5'} Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:26:50.610510 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. Sep 07 19:26:50.611860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:26:50.613004 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] Returning 404 to user: Instance 946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:26:50.613004 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-12c8c8e5-4d9d-41b6-8ccd-bc3c5b092372 tempest-AttachVolumeNegativeTest-1677661396 tempest-AttachVolumeNegativeTest-1677661396-project] 10.222.0.46 "GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5" status: 404 len: 111 microversion: 2.1 time: 0.029649 Sep 07 19:26:50.613004 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 534/1062] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:26:50 2022] GET /compute/v2.1/servers/946dffa0-f7e4-4a6c-bfb6-caa8a2bb8de5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:27:22.810925 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-218670594", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "networks": [{"uuid": "2cc0d46e-ea56-4def-9e86-32abc205543f"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:27:22.819858 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:22.820505 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:22.867306 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] validate_networks() for [('2cc0d46e-ea56-4def-9e86-32abc205543f', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:27:23.260195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:27:23.260652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:27:23.261128 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:27:23.261540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:27:23.261953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:27:23.271557 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:23.272040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:23.272477 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:23.273206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:23.273658 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:23.274088 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:23.291516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Getting quotas for project 8e25fa2f514648aa80ca55da8bb48cef. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:27:23.295552 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Getting quotas for user 05d4c61badff44108fb7f2ed329b50c8 and project 8e25fa2f514648aa80ca55da8bb48cef. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:27:23.306709 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:27:23.308988 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:27:23.433003 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f6a1281e-7613-4dca-8d8b-4b90e8942f1d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625931 Sep 07 19:27:23.433735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 529/1063] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:27:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:27:23.445158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b21910d6-b4b9-47f1-ab6f-8693cf71181c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:23.445773 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b21910d6-b4b9-47f1-ab6f-8693cf71181c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:23.448815 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:23.449774 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:23.505084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b21910d6-b4b9-47f1-ab6f-8693cf71181c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:23.513033 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b21910d6-b4b9-47f1-ab6f-8693cf71181c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1218 microversion: 2.1 time: 0.071989 Sep 07 19:27:23.513614 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 535/1064] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:23 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:24.538072 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:24.538735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:24.544965 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:24.545441 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:24.565503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:24.565503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:24.565503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:24.565503 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:24.609440 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:24.617701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a9aa84d4-cb9a-4cf7-bf5c-8bdc46ad70f5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1222 microversion: 2.1 time: 0.084418 Sep 07 19:27:24.618282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 530/1065] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:24 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:25.640942 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:25.641590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:25.648860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:25.649339 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:25.649764 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:25.650446 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:25.650915 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:25.651577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:25.714473 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:25.722657 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-46a9f8ec-47c9-4c04-8e03-7dd435c54352 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1278 microversion: 2.1 time: 0.085979 Sep 07 19:27:25.723226 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 536/1066] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:25 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:26.745498 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:26.746107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:26.753060 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:26.753540 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:26.753971 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:26.754693 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:26.755144 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:26.755559 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:26.889325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:26.897575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-81a995d6-e020-43ad-abd6-0e28142c747d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.156033 Sep 07 19:27:26.898261 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 531/1067] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:26 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:27.102295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5c5b6f-7e1a-4de0-9a77-899b853dbf82", "tag": "ba7d41fa-53a9-46fd-b18e-5ee999f40be2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:27:27.113487 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:27.113971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:27.114407 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:27.125276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] Creating event network-changed:ba7d41fa-53a9-46fd-b18e-5ee999f40be2 for instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 on hv-cinder-84773 Sep 07 19:27:27.130378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-6b644947-4c41-44f2-a22b-ded76c37c5af req-c7d7272d-0191-4296-b304-2fecadcd51e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034802 Sep 07 19:27:27.131010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 537/1068] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:27:27.921601 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:27.922215 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:27.929282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:27.929764 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:27.930202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:27.930920 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:27.931374 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:27.931794 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:28.058069 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:28.065702 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-8fdf21c1-a58b-4534-977e-17db201474d7 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.148147 Sep 07 19:27:28.066259 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 532/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:27 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:29.088612 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:29.089319 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:29.096025 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:29.096508 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:29.096944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:29.097640 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:29.098095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:29.098526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:29.229207 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:29.238022 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aaea3941-1ddb-49bf-8e37-42040383e50d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.152684 Sep 07 19:27:29.238147 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 538/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:29 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:30.259957 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:30.260579 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:30.267040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:30.267518 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:30.267953 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:30.269222 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:30.269670 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:30.270091 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:30.396369 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:30.404181 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3da11db7-dd78-4a83-b530-9626e37d1100 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.148148 Sep 07 19:27:30.404744 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 533/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:30 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:31.427639 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:31.428265 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:31.434868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:31.435357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:31.435801 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:31.436493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:31.436949 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:31.437378 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:31.563493 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:31.571247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d21e89b6-0d87-4c01-bbd1-55a0895333a0 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.147754 Sep 07 19:27:31.571856 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 539/1072] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:31 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:32.594927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:32.595732 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:32.602731 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:32.603247 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:32.603679 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:32.604377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:32.604830 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:32.605253 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:32.734468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:32.742962 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a11c3514-7161-44c0-a309-45077b3aee1a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.152054 Sep 07 19:27:32.743529 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 534/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:32 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:32.886445 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5c5b6f-7e1a-4de0-9a77-899b853dbf82", "name": "network-vif-plugged", "status": "completed", "tag": "ba7d41fa-53a9-46fd-b18e-5ee999f40be2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:27:32.896893 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:32.897870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:32.897870 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:32.909405 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] Creating event network-vif-plugged:ba7d41fa-53a9-46fd-b18e-5ee999f40be2 for instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 on hv-cinder-84773 Sep 07 19:27:32.914934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-17f2b2ca-08bb-428d-9ef6-3a8f2a263222 req-12b3e288-6450-44da-b1d3-fbd5706e804f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Sep 07 19:27:32.915527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 540/1074] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:27:33.765622 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:33.766243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:33.768143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:33.768804 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:33.774016 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:33.774500 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:33.776608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:33.776608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:33.776608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:33.776923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:33.901961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:33.909649 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-c7803967-1ba3-4297-a31b-3cca65dcfc4e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1318 microversion: 2.1 time: 0.147998 Sep 07 19:27:33.910214 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 535/1075] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:33 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:34.933580 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:27:34.934315 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:34.936367 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:34.942327 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:34.942838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:34.943276 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:34.943984 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:34.944436 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:34.944860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:35.075595 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:27:35.083936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e983d5bf-ba3e-47ed-9067-3795be0f901f tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1508 microversion: 2.1 time: 0.154575 Sep 07 19:27:35.084504 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 541/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:27:34 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:27:50.530885 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138c8753-db9b-4996-8189-99a4e61a26b7", "device": "/dev/sdb"}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:27:50.534931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:27:50.536458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:50.537298 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=38 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:27:50.542153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:50.542726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:50.543168 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:50.543869 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:27:50.544335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:27:50.544756 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:27:51.190244 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-d3cc9478-64bd-4381-90f0-b78f9898d685 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "POST /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663995 Sep 07 19:27:51.191014 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 536/1077] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:27:50 2022] POST /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:28:14.802157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:14.802717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:14.804836 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=16 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:14.805590 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=28 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:14.811468 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:14.811956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:14.812395 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:14.813089 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:14.813545 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:14.813965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:14.837053 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lazy-loading 'flavor' on Instance uuid 1cb41787-3f3f-44fe-ae16-268dde361552 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:28:15.120236 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d19da428-fd0d-4acf-b37d-7637966e4a2f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "POST /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552/action" status: 202 len: 0 microversion: 2.1 time: 0.321756 Sep 07 19:28:15.120993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 542/1078] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:28:14 2022] POST /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:28:15.130515 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:15.131335 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:15.134006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:15.134719 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:15.139891 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:15.140368 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:15.140803 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:15.141479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:15.141927 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:15.142366 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:15.275622 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:15.284192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-80931424-378c-47a2-821c-c0494d429eaf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.157954 Sep 07 19:28:15.284758 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 537/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:15 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:15.825706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:15.826385 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:15.832479 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:15.832962 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:15.833408 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:15.834089 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:15.834538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:15.834982 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:15.914713 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lazy-loading 'services' on Instance uuid 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:28:16.155460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-5ed81aea-1b44-40ca-a4b0-d98f33e10eff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82/os-volume_attachments/138c8753-db9b-4996-8189-99a4e61a26b7" status: 202 len: 0 microversion: 2.1 time: 0.334816 Sep 07 19:28:16.156072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 543/1080] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:28:15 2022] DELETE /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82/os-volume_attachments/138c8753-db9b-4996-8189-99a4e61a26b7 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:28:16.306802 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:16.307421 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:16.314508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:16.315030 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:16.315467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:16.316160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:16.316616 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:16.317020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:16.448012 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:16.456354 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-413d0aca-b481-4363-96a0-7f022cc38ef5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.153515 Sep 07 19:28:16.457114 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 538/1081] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:16 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:17.280133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:17.280731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:17.287726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.288244 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.288679 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.289382 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.289842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.290383 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.319054 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:28:17.479679 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:17.480228 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:17.487055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.487541 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.487982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.488701 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.489163 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.489591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.620293 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:17.628739 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2118d074-f95d-4d38-8a96-70edef1e9871 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.153064 Sep 07 19:28:17.629312 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 539/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:17 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:17.630343 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-96eb16cf-4058-478b-891b-dca567bd33a8 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 204 len: 0 microversion: 2.1 time: 0.355114 Sep 07 19:28:17.630993 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 544/1083] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:28:17 2022] DELETE /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:28:17.641602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:17.642269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:17.648287 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.648768 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.649206 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.649900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:17.650362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:17.650822 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:17.776735 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:17.784836 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9b16c5ea-3337-4eff-86cc-9b9fa81bb98a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1514 microversion: 2.1 time: 0.147037 Sep 07 19:28:17.785393 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 540/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:17 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:18.652989 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:18.653690 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:18.660130 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:18.660616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:18.661055 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:18.661838 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:18.662295 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:18.662750 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:18.798335 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:18.806072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-764321d9-478d-4c70-82b4-42c633cacfef tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.157586 Sep 07 19:28:18.806819 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 545/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:18 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:18.808123 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:18.808734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:18.816032 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:18.816508 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:18.816938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:18.817620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:18.818075 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:18.818484 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:18.943240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:18.950784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-7cf6aaa0-6883-495a-b9a1-a834b3149bbe tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1514 microversion: 2.1 time: 0.146619 Sep 07 19:28:18.951340 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 541/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:18 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:19.829488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:19.830133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:19.836793 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:19.837279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:19.837712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:19.838460 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:19.838890 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:19.839309 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:19.971391 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:19.973757 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:19.974381 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:19.980001 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-fd5e8351-7b06-497a-ac1a-aa2dc5f29915 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.154377 Sep 07 19:28:19.982723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 546/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:19 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:19.982859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:19.982859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:19.982859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:19.982859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:19.983212 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:19.983467 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:20.058063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:20.070090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2631a0c9-1529-481c-90c8-8915f19ffe29 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1472 microversion: 2.1 time: 0.097427 Sep 07 19:28:20.070978 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 542/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:19 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1472 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:20.074193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5c5b6f-7e1a-4de0-9a77-899b853dbf82", "name": "network-vif-deleted", "tag": "ba7d41fa-53a9-46fd-b18e-5ee999f40be2"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:20.084364 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:20.084860 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:20.085409 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:20.097139 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.compute.server_external_events [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] Creating event network-vif-deleted:ba7d41fa-53a9-46fd-b18e-5ee999f40be2 for instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 on hv-cinder-84773 Sep 07 19:28:20.102005 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-a3de7f5e-521d-4485-b2b0-604603e21035 req-106ed2ca-411f-4c35-b986-d09d735a6758 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031711 Sep 07 19:28:20.102792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 547/1089] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:28:21.003273 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:21.003938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:21.009983 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:21.010671 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:21.011062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:21.011760 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:21.012720 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:21.013135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:21.096084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:21.096957 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:21.104313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:21.104914 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:21.105550 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:21.106231 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:21.106786 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:21.107303 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:21.142115 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:21.142740 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:21.143236 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:21.143753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lazy-loading 'fault' on Instance uuid 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:28:21.155264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:21.164090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3245e0b1-5e5b-45f9-a54d-8bf10efab89f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.164685 Sep 07 19:28:21.164923 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 543/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:20 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:21.189783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:21.197634 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e1abc945-f119-470e-ae5e-18fdbc2ebe9a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 200 len: 1308 microversion: 2.1 time: 0.107616 Sep 07 19:28:21.198201 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 548/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:21 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:22.187466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:22.188083 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:22.194466 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:22.194974 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:22.195407 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:22.196094 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:22.196546 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:22.196964 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:22.221703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:22.222330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:22.228791 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:22.229278 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:22.229715 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:22.230420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:22.231482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:22.231933 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:22.245680 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] HTTP exception thrown: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Request method failure captured: Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 HTTP/1.1 Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGPCY19xXZsaUmXzI5fh7dHNsK2YmKI17_GtoVL45xbWri2casv_aEO4jXkEqh0J9-MtG3HvrN1iZ_41cf6U0t9R3DhCLRrfLSJX1v01fu_lRUJC3ZILaKypdedd8HYbI2zvdAeixSpnXA8USjipTkub_fEyOW5VqeA010VFDlI9W3Iw Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 8e25fa2f514648aa80ca55da8bb48cef Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:28:22.247587 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 8e25fa2f514648aa80ca55da8bb48cef Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-VolumesSnapshotTestJSON-1264448718-project Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 05d4c61badff44108fb7f2ed329b50c8 Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-VolumesSnapshotTestJSON-1264448718-project Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. Sep 07 19:28:22.249415 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '1c5c5b6f-7e1a-4de0-9a77-899b853dbf82'} Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:28:22.250401 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. Sep 07 19:28:22.251884 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:28:22.253170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Returning 404 to user: Instance 1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:28:22.253170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-91ab0f2f-88eb-41a4-99ee-e132c45f1be2 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82" status: 404 len: 111 microversion: 2.1 time: 0.031201 Sep 07 19:28:22.253170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 549/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:22 2022] GET /compute/v2.1/servers/1c5c5b6f-7e1a-4de0-9a77-899b853dbf82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:28:22.338201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:22.346422 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ce65eaec-9726-44e0-9633-ef4908ce7989 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.162856 Sep 07 19:28:22.347005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 544/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:22 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:23.370298 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:23.370934 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:23.378149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:23.378656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:23.379101 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:23.379788 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:23.380228 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:23.380643 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:23.510592 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:23.518812 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-893ffffd-31c0-4baf-8f91-2ca2d035d236 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.152359 Sep 07 19:28:23.519373 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 550/1094] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:23 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:24.541800 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:24.542343 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:24.548900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:24.549386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:24.549821 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:24.550510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:24.551041 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:24.551465 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:24.684931 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:24.693111 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-3e271b30-4c5b-4a8a-a2b4-e22bc3b8820b tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.155190 Sep 07 19:28:24.693687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 545/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:24 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:25.716847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:25.718107 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:25.724872 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:25.725384 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:25.725828 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:25.726520 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:25.726998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:25.727422 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:25.862731 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:25.870475 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-4cc51799-63bd-441c-a66c-49408fd42a41 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.157584 Sep 07 19:28:25.871557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 551/1096] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:25 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:26.894577 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:26.895201 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:26.902040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:26.903038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:26.903483 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:26.904178 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:26.904636 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:26.905062 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:27.036698 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:27.044406 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-f848cd0a-cd4a-402c-b05a-cd63fb1abee8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.153838 Sep 07 19:28:27.044961 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 546/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:26 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:28.067249 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:28.067847 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:28.074374 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:28.074891 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:28.075331 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:28.076023 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:28.076480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:28.076906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:28.201974 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:28.209675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-deec5ce3-52ee-40d9-991d-581c29f2a521 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.146340 Sep 07 19:28:28.210247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 552/1098] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:28 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:29.233304 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:29.233914 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:29.240403 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:29.240877 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:29.241305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:29.241991 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:29.242438 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:29.242886 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:29.369708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:29.378028 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-a629d39f-a6c2-4b39-901e-bb2a899c605f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.148689 Sep 07 19:28:29.378615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 547/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:29 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:30.401167 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:30.401783 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:30.408494 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:30.408971 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:30.409408 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:30.410108 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:30.410567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:30.410998 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:30.542279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:30.550538 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b72084a9-f574-485f-a5d2-93e1e11ce473 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.153507 Sep 07 19:28:30.551219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 553/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:30 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:30.600592 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2127890714", "imageRef": "b16a53b8-03d0-46ac-a06b-f159289efcf8", "flavorRef": "452", "networks": [{"uuid": "2cc0d46e-ea56-4def-9e86-32abc205543f"}]}} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:30.654057 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.network.neutron [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] validate_networks() for [('2cc0d46e-ea56-4def-9e86-32abc205543f', None, None, None, None, None)] {{(pid=121079) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 19:28:31.004195 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Flavor limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 19:28:31.004617 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Image limits 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 19:28:31.005121 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Flavor pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 19:28:31.005527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Image pref 0:0:0 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 19:28:31.005938 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.virt.hardware [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121079) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 19:28:31.014930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:31.015414 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:31.016107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:31.016571 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:31.017022 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:31.017447 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:31.034237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Getting quotas for project 8e25fa2f514648aa80ca55da8bb48cef. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 19:28:31.038235 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.quota [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Getting quotas for user 05d4c61badff44108fb7f2ed329b50c8 and project 8e25fa2f514648aa80ca55da8bb48cef. Resources: {'ram', 'instances', 'cores'} {{(pid=121079) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 19:28:31.049762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Going to run 1 instances... {{(pid=121079) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 19:28:31.052090 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b16a53b8-03d0-46ac-a06b-f159289efcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121079) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 19:28:31.165386 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-44bf3930-1f98-453c-b00f-c6dc5423dcbb tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567953 Sep 07 19:28:31.166224 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 548/1101] 10.222.0.46 () {60 vars in 1147 bytes} [Wed Sep 7 19:28:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 19:28:31.178320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-57ce24ba-b81d-4c57-843d-2d5d6a5d9684 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:31.179212 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-57ce24ba-b81d-4c57-843d-2d5d6a5d9684 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:31.231906 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-57ce24ba-b81d-4c57-843d-2d5d6a5d9684 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:31.239172 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-57ce24ba-b81d-4c57-843d-2d5d6a5d9684 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1219 microversion: 2.1 time: 0.065072 Sep 07 19:28:31.239965 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 554/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:31 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:31.573325 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:31.574444 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:31.580660 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:31.581143 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:31.581717 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:31.582423 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:31.582900 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:31.583332 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:31.717186 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:31.724982 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ec982b73-6377-4dd3-9e2a-95f5293c9a24 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.155600 Sep 07 19:28:31.725483 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 549/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:31 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:32.262689 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:32.263297 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:32.269656 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:32.270128 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:32.270577 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:32.271263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:32.271712 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:32.272140 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:32.333372 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:32.342113 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-589c6915-0a5f-4fe4-a065-5457c39db3ff tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1223 microversion: 2.1 time: 0.083768 Sep 07 19:28:32.343441 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 555/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:32 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:32.748748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:32.749358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:32.755700 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:32.756355 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:32.756790 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:32.757481 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:32.757926 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:32.758348 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:32.895946 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:32.908740 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-75a0429d-e8fc-41d1-bf16-c61eec85bb0a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.164051 Sep 07 19:28:32.909323 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 550/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:32 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:33.368433 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:33.369069 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:33.377153 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:33.377616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:33.378220 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:33.378970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:33.379426 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:33.379857 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:33.384330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:33.445068 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:33.454865 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-3bb8a5c8-3782-45b6-9119-8839e3d7d2d4 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1279 microversion: 2.1 time: 0.091082 Sep 07 19:28:33.455451 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 556/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:33 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:33.934031 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:33.934816 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:33.944894 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:33.945608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:33.946242 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:33.946985 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:33.947640 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:33.948078 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.088639 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:34.096726 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-0e350339-748b-4a45-bcc8-0b40c1ca6410 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1571 microversion: 2.1 time: 0.167732 Sep 07 19:28:34.097437 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 551/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:33 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:34.123515 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:34.124118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:34.130863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.131353 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.131829 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.132555 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.132995 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.133423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.174737 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121080) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 19:28:34.449569 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-ad0990f5-a3c0-4813-872f-dded956d61e5 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "POST /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552/action" status: 202 len: 0 microversion: 2.1 time: 0.330495 Sep 07 19:28:34.453292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 557/1108] 10.222.0.46 () {60 vars in 1278 bytes} [Wed Sep 7 19:28:34 2022] POST /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:28:34.458526 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:34.459282 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:34.467642 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.468411 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.468815 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.469602 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.470223 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.473079 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.478357 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:34.480093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:34.490071 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.490786 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.491313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:34.492095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:34.492621 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:34.493170 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:35.000510 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:35.008289 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eecf6ee5-9882-4bdf-bfb8-29c410dac70a tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1519 microversion: 2.1 time: 0.553707 Sep 07 19:28:35.009216 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 552/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:34 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1519 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:35.009889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:35.019421 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-bff12d2a-28f7-45f1-81ff-f884798357f9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.544991 Sep 07 19:28:35.025054 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 558/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:34 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:35.425517 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0de4ca-9a37-4ba3-8215-7efaf4a8deea", "tag": "50508c18-71d2-43fc-b4eb-b3082b6cdb5b"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:35.437458 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:35.438250 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:35.439122 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:35.451796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] Creating event network-changed:50508c18-71d2-43fc-b4eb-b3082b6cdb5b for instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea on hv-cinder-84773 Sep 07 19:28:35.457026 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e4d87161-ba66-4bf4-aa9f-bca992dc8559 req-e3a30df1-5955-4ca8-9510-fdd693cdd849 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036614 Sep 07 19:28:35.457632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 553/1111] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:28:36.033255 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:36.033807 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:36.041753 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:36.042292 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:36.046524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:36.046524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:36.046524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:36.046524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:36.047040 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:36.047468 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:36.054219 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:36.054959 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:36.055811 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:36.056796 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:36.057575 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:36.058237 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:36.265274 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:36.269145 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:36.272812 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=100 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:36.275482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-51a457c8-d6e7-49d4-abad-3dd502eb9a3f tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1521 microversion: 2.1 time: 0.243759 Sep 07 19:28:36.275482 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 559/1112] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:36 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:36.278829 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-44dea1d7-89d2-440c-b96e-57beb1071ed9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.238937 Sep 07 19:28:36.279482 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 554/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:36 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:37.059092 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "name": "network-vif-unplugged", "status": "completed", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:37.069060 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:37.069535 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:37.069956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:37.081152 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.compute.server_external_events [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] Unable to find a host for instance 1cb41787-3f3f-44fe-ae16-268dde361552. Dropping event network-vif-unplugged {{(pid=121080) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 19:28:37.082142 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [req-e8b9d503-f591-46f1-848b-8d92fe6735e0 req-f0c35635-34db-4362-80e8-195710a55e30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027628 Sep 07 19:28:37.086186 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 560/1114] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 07 19:28:37.297593 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:37.298215 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:37.301117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:37.302038 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:37.305042 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:37.305557 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:37.305993 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:37.306774 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:37.307229 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:37.307642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:37.307759 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:37.308667 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:37.309121 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:37.309810 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:37.310261 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:37.310717 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:37.503006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:37.506216 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:37.509930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-72f62fe6-081a-49d0-9b2d-5521b08300b8 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1521 microversion: 2.1 time: 0.216652 Sep 07 19:28:37.510513 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 555/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:37 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:37.514969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7623c4c8-43d0-4922-9366-e71b45a0d0ad tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.217682 Sep 07 19:28:37.515533 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 561/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:37 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:38.534589 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:38.535166 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:38.537091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:38.537706 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:38.541824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:38.542346 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:38.542820 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:38.543527 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:38.543984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:38.544093 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:38.544412 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:38.544527 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:38.544936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:38.545630 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:38.546085 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:38.546513 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:38.738842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:38.743151 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:38.747371 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0e10c0c2-2693-4072-bde3-0ca22761829e tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.214191 Sep 07 19:28:38.747961 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 562/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:38 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:38.751408 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b64214be-e857-4875-94e5-9fa4632342cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.221060 Sep 07 19:28:38.751977 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 556/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:38 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:39.770726 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:39.771428 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:39.774752 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:39.775336 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:39.778616 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:39.779229 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:39.779522 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:39.780340 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:39.780882 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:39.781205 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:39.782389 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:39.782906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:39.783352 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:39.784238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:39.784733 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:39.786635 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:39.980413 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:39.988867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:39.995158 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-78558e01-44f4-46b0-b276-52d15296a184 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.228359 Sep 07 19:28:39.996423 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 563/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:39 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:40.009373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-283cfa64-f070-4c55-b11f-06329d265580 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.228124 Sep 07 19:28:40.009373 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 557/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:39 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:41.018353 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:41.019038 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:41.021182 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:41.021956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:41.024507 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=2 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:41.026613 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:41.027106 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:41.027545 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:41.028243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:41.028695 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:41.028841 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:41.029120 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:41.029320 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:41.029757 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:41.030449 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:41.030944 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:41.031372 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:41.047358 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell0:SELECT=6 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:41.226337 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:41.230939 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:41.234930 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-13941018-98b3-4f4c-bb6b-78f6003bf0dc tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.220273 Sep 07 19:28:41.235301 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 558/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:41 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:41.239827 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0de4ca-9a37-4ba3-8215-7efaf4a8deea", "name": "network-vif-plugged", "status": "completed", "tag": "50508c18-71d2-43fc-b4eb-b3082b6cdb5b"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:41.242046 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell0:SELECT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:41.245062 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-496f9d80-78de-4fc1-8bfd-e6d5585906cf tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.227906 Sep 07 19:28:41.246193 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 564/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:41 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:41.256122 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:41.259784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:41.259784 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:41.269591 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] Creating event network-vif-plugged:50508c18-71d2-43fc-b4eb-b3082b6cdb5b for instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea on hv-cinder-84773 Sep 07 19:28:41.274243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-1b50ce23-f8bf-4bc5-954e-492cc2dad0b0 req-330a8907-0012-4dd3-addb-debe2fe2f1fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Sep 07 19:28:41.275031 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 559/1123] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:28:42.258576 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:42.259187 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:42.266490 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:42.266988 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:42.267420 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:42.268133 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:42.268672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:42.269095 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:42.271167 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:42.271882 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:42.278803 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:42.279290 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:42.279728 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:42.280422 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:42.280881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:42.281305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:42.465752 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:42.472873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:42.474658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d2ec3d94-f8e3-4201-ae5e-d526cbf93de5 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1319 microversion: 2.1 time: 0.219082 Sep 07 19:28:42.474658 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 565/1124] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:42 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:42.486859 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fc570ec4-55c3-4cf6-8253-2807b39bb4fd tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.220291 Sep 07 19:28:42.487825 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 560/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:42 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:43.496770 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:43.497377 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:43.503765 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.504241 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.504670 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:43.505361 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.505864 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.506217 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:43.511652 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:43.512278 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:43.518748 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.519238 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.519678 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:43.520378 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.520835 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.521264 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:43.706404 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:43.710881 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:43.714976 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-d5483b2c-4ddf-4e06-ae38-fb244de7ba39 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1509 microversion: 2.1 time: 0.221550 Sep 07 19:28:43.715642 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 566/1126] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:43 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:43.719377 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ba9dc417-ea53-411e-8626-ff9d7a5f905e tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.212156 Sep 07 19:28:43.719945 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 561/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:43 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:43.736749 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7cc4b21-b995-4b57-8044-e9b937b4808b", "device": "/dev/sdb"}} {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:43.739672 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:43.745480 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.745956 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.746388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:43.747164 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:43.747568 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:43.747992 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:44.541708 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-69bd08af-9666-46b7-9831-833517d0ca6d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "POST /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808614 Sep 07 19:28:44.542443 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 567/1128] 10.222.0.46 () {60 vars in 1323 bytes} [Wed Sep 7 19:28:43 2022] POST /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 19:28:44.742362 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:44.743056 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:44.749367 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:44.749842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:44.750276 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:44.750984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:44.751431 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:44.751846 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:44.886140 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:44.893907 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-ab65ae3f-9203-459b-aa46-bf5d77c1de95 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.155407 Sep 07 19:28:44.894475 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 562/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:44 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:45.919368 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:45.920017 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:45.921960 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:45.926875 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:45.927388 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:45.927830 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:45.928524 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:45.929011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:45.929435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:46.064675 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:46.072326 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-6c1f9226-699a-49e3-8c2b-c99614c13190 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.158404 Sep 07 19:28:46.072889 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 568/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:45 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:47.096209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:47.096866 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:47.099371 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:28:47.104113 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:47.104615 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:47.105623 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:47.105745 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:47.106199 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:47.106864 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:47.240357 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:47.248996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-353e8293-9510-483a-8578-3b66ec6c3984 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.156687 Sep 07 19:28:47.249580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 563/1131] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:47 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:48.275072 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:48.276064 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:48.282936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:48.283417 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:48.283854 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:48.284532 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:48.284977 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:48.285394 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:48.420697 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:48.428397 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-e171fb5b-bf18-4818-8168-6ca70d6e13b4 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.157173 Sep 07 19:28:48.428967 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 569/1132] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:48 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:28:49.170067 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "name": "network-vif-plugged", "status": "completed", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:28:49.180055 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:49.184232 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:49.184232 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:49.194687 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] Creating event network-vif-plugged:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:28:49.199769 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-a0053a0c-2461-48c0-94ed-ec965e3e98e8 req-5298ca63-44fb-4fcc-9ea8-205c017249fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Sep 07 19:28:49.200334 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 564/1133] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:28:49.450762 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:49.451348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:49.457747 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:49.458247 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:49.458705 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:49.459418 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:49.459863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:49.460279 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:49.599316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:49.607786 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-92783ecb-728b-417e-8f1d-e0be715f2c60 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1577 microversion: 2.1 time: 0.161018 Sep 07 19:28:49.608355 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 570/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:49 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:28:50.631932 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:28:50.632628 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:28:50.638708 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:50.639189 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:50.639620 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:50.640305 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:28:50.640788 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:28:50.641209 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:28:50.772772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:28:50.780837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-9d94bb59-abde-4aa9-8e9f-5fba26002c20 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1564 microversion: 2.1 time: 0.153570 Sep 07 19:28:50.781398 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 565/1135] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:28:50 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 19:29:05.441557 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:05.442045 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:05.444673 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=5 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:29:05.445330 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:29:05.449970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:05.450452 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:05.450936 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:05.451632 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:05.452087 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:05.452518 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:05.536703 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lazy-loading 'services' on Instance uuid 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:29:05.695781 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-7cff2aac-1c97-4823-b811-16c7091d3a2a tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea/os-volume_attachments/c7cc4b21-b995-4b57-8044-e9b937b4808b" status: 202 len: 0 microversion: 2.1 time: 0.257938 Sep 07 19:29:05.696313 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 571/1136] 10.222.0.46 () {58 vars in 1416 bytes} [Wed Sep 7 19:29:05 2022] DELETE /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea/os-volume_attachments/c7cc4b21-b995-4b57-8044-e9b937b4808b => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 19:29:07.877269 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:07.877824 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:07.879992 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=5 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:29:07.880650 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=58 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:29:07.885680 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:07.892202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:07.892202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:07.892202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:07.892202 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:07.892690 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:07.912842 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Going to try to terminate instance {{(pid=121079) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:29:08.159416 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-2dffd870-31cf-4914-89d6-a04316c77e0b tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 204 len: 0 microversion: 2.1 time: 0.285977 Sep 07 19:29:08.160006 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 566/1137] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:29:07 2022] DELETE /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:29:08.170011 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:08.171300 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:08.177537 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:08.178010 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:08.178437 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:08.179171 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:08.179617 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:08.180032 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:08.308461 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:29:08.316196 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-a9c33828-1fba-4ab8-9ca2-6cc6f259413d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1515 microversion: 2.1 time: 0.151557 Sep 07 19:29:08.316766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 572/1138] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:29:08 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:29:09.339112 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:09.339807 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:09.346240 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:09.346762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:09.347192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:09.347873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:09.348319 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:09.348734 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:09.484980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:29:09.484980 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-75bc172b-93ab-4808-967e-981534f1f36c tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1515 microversion: 2.1 time: 0.149999 Sep 07 19:29:09.485446 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 567/1139] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:29:09 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:29:10.508548 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:10.509118 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:10.516512 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:10.517149 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:10.517589 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:10.518286 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:10.518766 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:10.519195 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:10.652305 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:29:10.659987 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-dd1694c1-9540-4dc4-ab98-2ece94b41df9 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1515 microversion: 2.1 time: 0.155648 Sep 07 19:29:10.660901 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 573/1140] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:29:10 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:29:10.774020 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0de4ca-9a37-4ba3-8215-7efaf4a8deea", "name": "network-vif-deleted", "tag": "50508c18-71d2-43fc-b4eb-b3082b6cdb5b"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:29:10.784107 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:10.784580 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:10.785005 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:10.795845 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] Creating event network-vif-deleted:50508c18-71d2-43fc-b4eb-b3082b6cdb5b for instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea on hv-cinder-84773 Sep 07 19:29:10.800873 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-e09d8ab7-0522-437b-bfb9-f31918e48c71 req-7597aa9f-0fb0-4544-bfe6-b929b7f5a1af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030503 Sep 07 19:29:10.801444 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 568/1141] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:29:11.682842 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:11.683457 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:11.690106 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:11.690596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:11.691034 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:11.691725 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:11.692177 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:11.692598 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:11.724868 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:11.725348 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:11.725780 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:11.726224 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.objects.instance [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lazy-loading 'fault' on Instance uuid 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea {{(pid=121080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:29:11.767792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d4c61badff44108fb7f2ed329b50c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e25fa2f514648aa80ca55da8bb48cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:29:11.775792 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-f82f5db0-1969-4616-ac27-8ccc58102d7d tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 200 len: 1309 microversion: 2.1 time: 0.096704 Sep 07 19:29:11.776991 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 574/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:29:11 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:29:12.800608 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:29:12.801311 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] [instance: 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:29:12.807646 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:12.808135 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:12.808576 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:12.809270 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:29:12.809725 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:29:12.810153 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:29:12.823275 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.wsgi [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] HTTP exception thrown: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Request method failure captured: Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: request: GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea HTTP/1.1 Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept: application/json Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Accept-Encoding: identity Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Connection: close Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Length: 0 Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Content-Type: application/json Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Host: 10.222.0.46 Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: Openstack-System-Scope: None Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: User-Agent: python-urllib3/1.26.12 Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Auth-Token: gAAAAABjGPCY19xXZsaUmXzI5fh7dHNsK2YmKI17_GtoVL45xbWri2casv_aEO4jXkEqh0J9-MtG3HvrN1iZ_41cf6U0t9R3DhCLRrfLSJX1v01fu_lRUJC3ZILaKypdedd8HYbI2zvdAeixSpnXA8USjipTkub_fEyOW5VqeA010VFDlI9W3Iw Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Id: None Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Domain-Name: None Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Identity-Status: Confirmed Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Is-Admin-Project: True Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Id: default Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Domain-Name: Default Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Id: 8e25fa2f514648aa80ca55da8bb48cef Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Role: member,reader Sep 07 19:29:12.824889 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Roles: member,reader Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8e25fa2f514648aa80ca55da8bb48cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Id: 8e25fa2f514648aa80ca55da8bb48cef Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1264448718 Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User: tempest-VolumesSnapshotTestJSON-1264448718-project Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Id: default Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Domain-Name: Default Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Id: 05d4c61badff44108fb7f2ed329b50c8 Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: X-User-Name: tempest-VolumesSnapshotTestJSON-1264448718-project Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: method: > Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: exception: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. Sep 07 19:29:12.826645 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: action_args: {'id': '6e0de4ca-9a37-4ba3-8215-7efaf4a8deea'} Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:29:12.827712 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. Sep 07 19:29:12.829148 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR nova.api.openstack.wsgi Sep 07 19:29:12.830472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] Returning 404 to user: Instance 6e0de4ca-9a37-4ba3-8215-7efaf4a8deea could not be found. {{(pid=121079) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:29:12.830472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-fae975ea-dc9f-4bf7-8ce8-7e0893ecc023 tempest-VolumesSnapshotTestJSON-1264448718 tempest-VolumesSnapshotTestJSON-1264448718-project] 10.222.0.46 "GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea" status: 404 len: 111 microversion: 2.1 time: 0.030403 Sep 07 19:29:12.830472 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 569/1143] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:29:12 2022] GET /compute/v2.1/servers/6e0de4ca-9a37-4ba3-8215-7efaf4a8deea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 19:30:12.236067 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_api:SELECT=10 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:30:12.236821 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG dbcounter [-] [121080] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:30:12.237963 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 19:30:12.238114 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Wed Sep 7 19:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 (ip 10.222.0.46) !!! Sep 07 19:30:12.242705 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:30:12.246316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:12.246316 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:12.250455 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:12.252045 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:30:12.252696 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG dbcounter [-] [121079] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 19:30:12.254761 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:12.255222 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:12.255969 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:12.256435 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:12.256866 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:12.258516 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:12.259037 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:12.259479 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:12.272960 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] Creating event network-changed:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:30:12.278651 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-ab72a6e5-ecc8-4d8f-a527-09c260cf2209 req-12e860dc-9e62-4626-8329-1627e020d32d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Sep 07 19:30:12.279808 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 570/1144] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:30:12.290157 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Going to try to terminate instance {{(pid=121080) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 19:30:12.678334 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-0091e1af-eebb-4f96-b908-bbc1af894ef1 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 204 len: 0 microversion: 2.1 time: 0.443801 Sep 07 19:30:12.681289 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 575/1145] 10.222.0.46 () {58 vars in 1239 bytes} [Wed Sep 7 19:30:12 2022] DELETE /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 19:30:12.689023 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:12.689715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:12.698254 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:12.698896 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:12.699243 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:12.700266 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:12.700833 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:12.701951 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:13.043984 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:30:13.059150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-b70dbc13-5cd5-4fa3-9d57-77dccd6273e3 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1570 microversion: 2.1 time: 0.373975 Sep 07 19:30:13.059150 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 571/1146] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:30:12 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1570 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:30:14.083562 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:14.084263 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:14.093189 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:14.093678 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:14.096219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:14.096219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:14.096219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:14.096219 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:14.283526 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:30:14.291372 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-aacd1fb2-071c-46e8-a8b8-874fd3d526c9 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1451 microversion: 2.1 time: 0.213669 Sep 07 19:30:14.291935 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 576/1147] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:30:14 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1451 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:30:15.009867 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cb41787-3f3f-44fe-ae16-268dde361552", "name": "network-vif-deleted", "tag": "e9304752-b8fe-4b84-90d5-2ca9374937d1"}]} {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 19:30:15.020067 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:15.024715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:15.024715 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:15.034063 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.compute.server_external_events [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] Creating event network-vif-deleted:e9304752-b8fe-4b84-90d5-2ca9374937d1 for instance 1cb41787-3f3f-44fe-ae16-268dde361552 on hv-cinder-84773 Sep 07 19:30:15.039192 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [req-c507bd56-8478-499a-8ad2-c54eeb718156 req-785fc0d7-5cd7-40ab-acaf-4378c1706423 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090695 Sep 07 19:30:15.039772 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 572/1148] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Sep 7 19:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 19:30:15.316578 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:15.317850 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:15.324970 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:15.325542 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:15.326117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:15.327203 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:15.327723 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:15.328210 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:15.392091 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.policy [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121080) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:30:15.400075 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-b40be4de-e10f-4d4d-8591-3203b7226922 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1219 microversion: 2.1 time: 0.087931 Sep 07 19:30:15.400593 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 577/1149] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:30:15 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:30:16.423837 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:16.424632 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.compute.api [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121079) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:16.431160 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:16.436296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:16.436296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:16.436296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:16.436296 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:16.436697 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:16.464943 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:16.465422 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:16.465852 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG oslo_concurrency.lockutils [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121079) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:16.466297 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.objects.instance [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lazy-loading 'fault' on Instance uuid 1cb41787-3f3f-44fe-ae16-268dde361552 {{(pid=121079) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 19:30:16.507491 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.policy [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5076bee4033c4fa8837c3273a2e53a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ebd705b0d94555bbc24018ac4b9d0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121079) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 19:30:16.515326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-eafa9d72-3dd9-40ae-acf4-6e8ea81714fa tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 200 len: 1224 microversion: 2.1 time: 0.095736 Sep 07 19:30:16.516562 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 573/1150] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:30:16 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 19:30:17.539863 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '>' {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:17.540488 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.compute.api [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [instance: 1cb41787-3f3f-44fe-ae16-268dde361552] Fetching instance by UUID {{(pid=121080) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 19:30:17.547084 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:17.547567 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:17.548004 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:17.548707 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Acquiring lock "830cd0e6-a124-4034-b556-b105279cb03a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 19:30:17.549169 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 19:30:17.549596 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG oslo_concurrency.lockutils [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Lock "830cd0e6-a124-4034-b556-b105279cb03a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121080) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 19:30:17.562814 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.wsgi [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] HTTP exception thrown: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Request method failure captured: Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: request: GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 HTTP/1.1 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept: application/json Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Accept-Encoding: identity Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Connection: close Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Length: 0 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Content-Type: application/json Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Host: 10.222.0.46 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: Openstack-System-Scope: None Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: User-Agent: python-urllib3/1.26.12 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Auth-Token: gAAAAABjGPArgYz39b63XhKcjGVy1JDxdhYE0SoOOxqwW0CJAOR0MWwmwRbRx8HfRIRpAFuqGK6RANP47JFgWXNacrbnYrFZHvhnoWt7QlRHjvdQKL0GmNAl2HPVgDaXNWCe23mda84lj2sNk1k7BAF-mIOgOovV2pNS7EtcVaGpUP_37qWZZd8 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Id: None Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Domain-Name: None Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Identity-Status: Confirmed Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Is-Admin-Project: True Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Id: default Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Domain-Name: Default Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Id: 67ebd705b0d94555bbc24018ac4b9d0f Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Project-Name: tempest-TestShelveInstance-1617543471 Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Role: member,reader Sep 07 19:30:17.564454 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Roles: member,reader Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/67ebd705b0d94555bbc24018ac4b9d0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_67ebd705b0d94555bbc24018ac4b9d0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/67ebd705b0d94555bbc24018ac4b9d0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/67ebd705b0d94555bbc24018ac4b9d0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}] Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant: tempest-TestShelveInstance-1617543471 Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Id: 67ebd705b0d94555bbc24018ac4b9d0f Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-Tenant-Name: tempest-TestShelveInstance-1617543471 Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User: tempest-TestShelveInstance-1617543471-project Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Id: default Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Domain-Name: Default Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Id: 5076bee4033c4fa8837c3273a2e53a7a Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: X-User-Name: tempest-TestShelveInstance-1617543471-project Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: method: > Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: exception: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. Sep 07 19:30:17.566237 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: action_args: {'id': '1cb41787-3f3f-44fe-ae16-268dde361552'} Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: {{(pid=121080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 19:30:17.567336 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. Sep 07 19:30:17.569117 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: ERROR nova.api.openstack.wsgi Sep 07 19:30:17.570704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: DEBUG nova.api.openstack.wsgi [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Returning 404 to user: Instance 1cb41787-3f3f-44fe-ae16-268dde361552 could not be found. {{(pid=121080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 19:30:17.570704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: INFO nova.api.openstack.requestlog [None req-df15c68a-520e-439e-ae91-33e9b86b27dc tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552" status: 404 len: 111 microversion: 2.1 time: 0.029876 Sep 07 19:30:17.570704 dv-cinder-847732-5-iscsi devstack@n-api.service[121080]: [pid: 121080|app: 0|req: 578/1151] 10.222.0.46 () {58 vars in 1236 bytes} [Wed Sep 7 19:30:17 2022] GET /compute/v2.1/servers/1cb41787-3f3f-44fe-ae16-268dde361552 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 19:30:17.811996 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: DEBUG nova.api.openstack.wsgi [None req-39515f39-aeb3-4328-8d36-4b95222ed030 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] Calling method '.version_select at 0x7ff4da467d30>' {{(pid=121079) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 19:30:17.817125 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39515f39-aeb3-4328-8d36-4b95222ed030 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [29656972-5ae6-4922-8760-e0e7d1bcc2bb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 07 19:30:18.824762 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO oslo.messaging._drivers.impl_rabbit [None req-39515f39-aeb3-4328-8d36-4b95222ed030 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] [29656972-5ae6-4922-8760-e0e7d1bcc2bb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 57614. Sep 07 19:30:18.901326 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: INFO nova.api.openstack.requestlog [None req-39515f39-aeb3-4328-8d36-4b95222ed030 tempest-TestShelveInstance-1617543471 tempest-TestShelveInstance-1617543471-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1346289401" status: 202 len: 0 microversion: 2.1 time: 1.094078 Sep 07 19:30:18.901906 dv-cinder-847732-5-iscsi devstack@n-api.service[121079]: [pid: 121079|app: 0|req: 574/1152] 10.222.0.46 () {58 vars in 1254 bytes} [Wed Sep 7 19:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1346289401 => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)